Discussion about this post

User's avatar
JP's avatar

The bit about Alibaba's Qwen models being safe to run locally vs using their hosted services is a distinction most people miss entirely. Compliance-by-architecture rather than compliance-by-policy. I've been digging into the Qwen 3.5 small models specifically and the 4B and 9B variants are genuinely impressive for local inference. Wrote up the full breakdown here: https://reading.sh/your-laptop-is-an-ai-server-now-370bad238461?sk=1cf7a4391e614720ecbd6e9bc3f076a2

Pawel Jozefiak's avatar

"Do you really want tech bros to know what you're asking AI?" - valid concern. The privacy angle on local AI is underrated. My setup runs locally via Claude Code on my Mac - the data never leaves my machine unless I explicitly send it somewhere. The tradeoff is compute power and model access, but for personal automation the local models are good enough now. Worth the privacy. https://thoughts.jock.pl/p/wiz-personal-ai-agent-claude-code-2026

No posts

Ready for more?