Local LLM on Proxmox
Has anyone managed to achieve this successfully for daily work? My specs:
Aoostar WTR Max 8845
- CPU: AMD Ryzen 7 PRO 8845HS (8-core, 16-thread, up to 5.1 GHz)
- GPU: Integrated GPU: AMD Radeon 780M (RDNA 3, up to 2700MHz)
- RAM2x 64Gb DDR5-5600 SODIMM slots (128GB)
There are many opinions on the Internet about recommended hardware like a dedicated GPU but I just want to start with the iGPU first then scale up once I find the quality acceptable.
3
4 comments
Local LLM on Proxmox
skool.com/homelabexplorers
Build, break, and master home labs and the technologies behind them! Dive into self-hosting, Docker, Kubernetes, DevOps, virtualization, and beyond.
Leaderboard (30-day)
1
+94
2
+58
3
+19
4
+16
5
+15
Powered by