orange pi looks very promising

Ubuntu 6.06 LTS

Same thing. Inference just uses a lot less memory.

7900XTX

is it with Automatic1111?

Things have changed.

I can now run mistral on my intel iGPU using Vulkan.

At least the Arch people are not shilling for some corp.

https://ollama.com/blog/amd-preview

Flatpak is crazy inefficient, but at least I can get software that is not yet on distro repos. It will get better.

I use ubuntu because my provider has that by default. It’s not my favourite distro these days, but gets the job done.

I had a similar question: https://lemmy.ml/post/12919434

Docker makes sense if you are deploying thousands of machines in the cloud. I don’t think it makes as much sense if you have your own hardware.

Some services do have 1-line installers with docker, so those might be useful. But they usually have 1-line non-docker installers too.

promising, thx!

Syncthing

looks promising, thanks!

I was looking into Nextcloud! It was my first thought.