• 0 Posts
  • 13 Comments
Joined 3 years ago
cake
Cake day: March 21st, 2024

help-circle






  • CheesyFox@lemmy.sdf.orgtoLocalLLaMA@sh.itjust.works•Poor little Qwen
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    11 days ago

    it’s a cloud service. It gives you access to an api. It couldn’t care less about your GPU. Can be used on anything that is capable of internet connection. Specifically NIM has a max requests per minute restriction tho. Due to this, running ai agents on it would be a pain in the ass, but technically possible (still not as painful as local inference tho). And it still works fine for plain chats.


  • i guess my advice is misplaced, given the community name, but in case the goal is to get LLM inference for free, not necessarily a local one, you could try opencode (their free plan gives you access to some decent models), or nvidia’s NIM if you don’t want a vendor lock-in to any specific agent/chat app.


  • please buy some fruits and vegetables from time to time. Actually a lot of time. Different vegetables and fruit. Some nuts too. Eating the same meal every day is very unhealthy and can have very bad l andasting consequences for your health, especially in combination with stress (i know this from my personal experience of being poor and autistic unfortunately). And “hunger pains”? This is already very not ok.

    Maybe start a gofundme campaign to at least temporarily somewhat mitigate the money problem? I’ll gladly send you a few bucks, if it helps you avoid what i got through.