I benchmarked a bunch of Local LLMs on Ollama

It was a quiet weekend and i felt like a change of pace.I always mean to run Locall LLM's on my desktop PC but I vever really stick at it. This weekend I wrote some rudimentary benchmarking tests so I could compare the performance of my Custom AI PC and my MacBook Pro M4 max. The results were quite surprising.

Anyhoo I wrote it up and published it on Medium incase anyone fancies a 10 min read.

0 comments