• chicken@lemmy.dbzer0.com
    link
    fedilink
    arrow-up
    1
    ·
    25 days ago

    Seems kind of impractical, why even bother with trying to propagate a 4b model running at 0.39 tokens per second if you could instead make a conventional worm using a more powerful AI model targeting known devices? It seems like the only reason you would want to do this is if you can only find vulnerabilities while actually on the given network, but that would be kind of niche since how many people are really running totally custom stuff?

    • gh0stcassette@lemmy.blahaj.zone
      link
      fedilink
      arrow-up
      1
      ·
      25 days ago

      Yeah the actually scary kind of AI worm is one that scrapes dozens to hundreds of credentials people accidentally pushed to GitHub and spreads its API requests across all of them to minimize the chance of being noticed. Not something that requires downloading 5GB+ of LLM to someone’s potato ass hardware and running it at half a token per second.

    • melfie@lemmy.zip
      link
      fedilink
      arrow-up
      1
      ·
      25 days ago

      Yeah, hard to get local LLMs running decently fast even when done deliberately. Like people aren’t going to notice their CPU, memory, and GPU are all getting pegged when this malware runs?

      Come on, Anthropic, you need to do better than this if you want your “open LLMs dangerous” marketing campaign to be credible.

        • BlaestEgnen@feddit.dk
          link
          fedilink
          arrow-up
          1
          ·
          24 days ago

          But how do they access IoT devices without access to the WiFi they’re connected on?

          I guess the argument is most IoTs can be accessed through open external IP ports?

          • NotMyOldRedditName@lemmy.world
            link
            fedilink
            arrow-up
            1
            ·
            24 days ago

            Many of these IoT devices have incredibly poor security and if they’re connected to the internet can be hacked. The bigger models are very good at finding exploits and using them as well, so it could search for devices and break into vulnerable ones then send something to self replicate and start process.

            The bigger models might exploit the parents company as well and get in that way. E.g hack a smart security camera company and then find a way into the cameras.

  • smeg@feddit.uk
    link
    fedilink
    English
    arrow-up
    1
    ·
    25 days ago

    So they need brand new top-of-the-line GPUs, but they’re also capable of running on old unpatched IoT devices?

    • NotMyOldRedditName@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      edit-2
      25 days ago

      I didnt read it all, its long, but they did mention it generating tokens at 0.39/s on one. So its slow as fuck, but it doesnt care like we would.

        • NotMyOldRedditName@lemmy.world
          link
          fedilink
          arrow-up
          1
          ·
          24 days ago

          The AI that attempts to self replicate on the IoT type devices. (if a pile of these appear, it kept showing “error” when submitting)

          • esc@piefed.social
            link
            fedilink
            English
            arrow-up
            1
            ·
            24 days ago

            ‘The AI’ attempts nothing unless it made to do something, it can be explicit command or something that it can get implicitly from given command. Programs don’t just ‘do’ things.