A small detour from my design posts.
Yesterday I prototyped a local offline agent that refines its implementation & memory when idle. I wanted it to work offline so the agent could be improved from anywhere.
Next I’d like to implement parsing issues & submitting pull requests.
Well, my mind is pretty blown by how easy it is to run DeepSeek-R1:32B and Qwen2.5-Coder:32B offline on my MacBook Pro (M3 Pro). Each model is only 19GB in size.
This opens up so many possibilities…