Hacker News · DEV
Local AI models are suddenly good enough to ship
I've been working with local models since they came out, and finally, they're surprisingly good now.
Early on, models were slow, hard to use, and just not that accurate for most programming tasks. The idea that local models were severely lagging behind was largely true until, for me, the release of GPT-OSS.
As a result, I've mostly been using local models as fast, personalized Google for development questions that don't require recency.
But with the most recent releases from Google in the Gemma 4 , family, I've finally been able to do agentic coding locally and have loops work at about ~75% the accuracy/speed of frontier models, which is incredible.
I've so far been using gemma-4-26b-a4b LM Studio implementation as my default local model. I've used the local setup so far to: Refactor a Python script that was a notebook into a repo of 5-6 modules, lint that module to use correct type hints for generics (most frontier models now do this automatically, but not always).