Has anyone tried in organization to use self hosted llm models for agentic programming?
Im curious if it makes any sense. My organization spends fortune on tokens from us companies. I want to recommend something…
You must log in or register to comment.
I would recommend Qwen4-27B + CoDoc
What is CoDoc? Have a look at the recent post I published so that you have all context (no pun intended) ;)
IMO, massive costs savings ahead for those that adopt the set-up above.
our CEO has been buying new hires desktop gaming machines for this reason… currently they don’t have squat for graphics cards but once the rug is pulled from the cloud model pricing he said he’ll spend the $10k per machine to put a 96gb vram card in peoples’ machines to run shit locally
