5·
7 months agoDebian has official support for RISC V boards, but they don’t have officially available images for those boards (at least not the Mars).
Tempo
25 | he/him | Wiradjuri | Junior Vice President of generallyrubbish dot net
- 0 Posts
- 2 Comments
Joined 2 years ago
Cake day: July 7th, 2022
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
They’re Ryzen processors with “AI” accelerators, so an LLM can definitely run on hardware on one of those. Other options are available, like lower powered ARM chipsets (RK3588-based boards) with accelerators that might have half the performance but are far cheaper to run, should be enough for a basic LLM.