

1·
2 months agoQwen3.5-35B-A3B is the most powerful model you could run on your sell-eventually desktop, because it is MOE (mixture of experts) you can split its 22GB 4bit variant over both CPU and GPU and achieve workable performance. Use llama.cpp-cuda directly to save overhead, Claude can even help you set up a performance tested start script for your configuration. Hopefully Qwen3.8 will drop soon in a similar variant. On the other hand, deepseek 4 flash on openrouter.ai beats it easily and is energy cost level cheap. I would take that route over smaller models on programming duty on your weaker hardware.
According to your link, it was fixed 19h ago in 7.3.0-3. Did the fix not work?