What tools and projects do you use for your local LLM chats and agents?

I’m trying to sift through the mess of LLM harness and tools to find how to really get the most out of local LLMs.

  • Riskable@programming.dev
    link
    fedilink
    English
    arrow-up
    2
    ·
    5 days ago

    The anti-AI sentiment here is ridiculous. They were asking a legitimate question!

    I just use ollama locally but I keep meaning to setup OpenRouter because I like to play with larger models that my hardware can’t handle and I’d like to be able to pick the best deals 🤷‍♀️

    • YeahToast@aussie.zone
      link
      fedilink
      English
      arrow-up
      1
      ·
      5 days ago

      AI effectively raped and pillaged all human information for the benefit of a handful of corporations. It’s use has been shown to reduce the skills of school children and even deskill those with established knowledge. Then there’s the environmental considerations in a time where the world is decades behind appropriate climate change management… Id say it’s pretty understandable that it evokes passionate responses.

      • Freeposity@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 days ago

        AI effectively raped and pillaged all human information

        Copying information is not theft. Learning from copied information is not theft.

        Theft is when you take something and deprive the owner of what you took. If I make a copy of your car, I am not stealing your car, you still have it and can drive it, wreck it, whatever.

        • YeahToast@aussie.zone
          link
          fedilink
          English
          arrow-up
          0
          ·
          4 days ago

          Theft is when you take something and deprive the owner of what you took

          So google ai summary now taking content from the web and putting at the top of their search, thus generally stopping people clicking on websites and taking their revenue -> theft.

            • YeahToast@aussie.zone
              link
              fedilink
              English
              arrow-up
              0
              arrow-down
              1
              ·
              3 days ago

              Free referrals to their site? What are you talking about? Google is a search engine, an indexer, its role is to point people to websites based on their search terms. It now scrapes all of the websites information and people no longer visit those websites???