Whereas you can just run a smaller model, say 8B using Docker and Ollama on a laptop using “free” electricity from the panels on your roof.

Seems to work well on my old M1 MacBook Pro with no issues.