I’m in the early stages of this myself and haven’t actually run an LLM locally but the term that steered me in the right direction for what I was trying to do was ‘RAG’ Retrieval-Augmented Generation.

ragflow.io (terrible name but good product) seems to be a good starting point but is mainly set up for APIs at the moment though I found this link for local LLM integration and I’m going to play with it later today. https://github.com/infiniflow/ragflow/blob/main/docs/guides/deploy_local_llm.md

I wonder what would happen if Red Hat took the opportunity to start advertising anti-Windows-Wokeness on X and TruthSocial and other fascsocial media. Probably a stupid business move because not like they’d actually adopt it but would be funny to watch.

I’m still running LXDE on an Acer netbook I got in 2010 or so. Tiny, underpowered little thing but still has a physical NIC which is why I still love it.

I spent many years trying to sound insulate band and recording rooms on the cheap. I’m not an engineer but from my experience you need mass to stop street noise, which has a lot of low frequency power. No amount of foam or fluffy fabric will make a noticeable difference. Save your money on the ‘soundproof’ fabrics, they’re no better than furniture pads, which can help a little but just aren’t dense enough to stop much bass. Best I’ve found for windows is particle board with chunks of tire rubber nailed on. But you probably don’t want to board up your windows so that’s probably not a good solution for you

I always wanted to find a heavy sheet of rubber to see if that worked but never found anything affordable I could repurpose. Also wonder if heavy muslin dipped in some kind of rubber material might do anything, but never tried that either. Maybe something like those flaps they use in commercial coolers, those are pretty dense, but a sheet. Sorry no specific recommendations for your case but keep a look out for any dense material you could fashion into a curtain or window cover.

But also just check around your windows if it they need any sealing. A tiny opening can transmit a lot more sound than you think.