Ollama just dropped a great new enhancement
Better memory management and scheduling. I wrote up a VHT forum post here: https://www.virtualizationhowto.com/community/artificial-intelligence-ai/ollama-adds-new-memory-management-and-scheduling-improvements-to-the-latest-release/