• 0 Posts
  • 15 Comments
Joined 3 years ago
cake
Cake day: June 12th, 2023

help-circle

  • It’s been headline news (at least by Lemmy standards), so it’s a safe bet that Earthwormjim91 was alluding to it when he initially brought up Torvalds, and I was referring to it when I initially brought up optimisation. It wouldn’t have been clear to you if you hadn’t known about it already, as no one linked an article or said explicitly that that’s what they were referring to, but for someone who did, it would have been obvious. You wouldn’t expect someone to explicitly say they were referencing Shrek if they said that something had layers or something was sacrifice someone was willing to make when it clearly would only affect other people, and you wouldn’t expect someone to explicitly say they were referring to Trump’s infamous COVID-era press conference if they mentioned injecting bleach.



  • It’s not really gaming the algorithm. There’s no karma here, no one buying high-karma accounts for advertising, and no one chasing attention when the maximum attention a Lemmy post gets isn’t very much because there aren’t very many users, so there’s no point trying to artificially boost engagement. People are just posting things when they’re online and not posting things when they’re offline, and there are few enough users that it doesn’t take many to create a pattern, and it sounds like you just happen to check at a similar cadence to a few anime fans, so keep seeing things right after they’ve browsed and upvoted what they like. I just checked the All Communities Hot feed on lemmy.world with no communities blocked, and only see one anime-related post in the first five pages, so they’re clearly not constantly at the top. Considering the demographics that would typically use Lemmy, that’s a really low number.


  • It only needs to save a few hundreds of seconds on one computer, or one second on a few hundreds of computers, or a tiny fraction of a second on the number of computers that actually run Linux to save trillions of cycles. A trillion cycles isn’t very many at all. A hundred-word prompt on a frontier model running on GPUs in a datacentre burns much more power than a trillion cycles on a CPU, so for a large Linux kernel patch, trillions is the wrong number by many orders of magnitude. There are also a lot of computers spending a lot of time running Linux, so it kind of balances out. There’s only one Linus Torvalds, and he’s very busy, so it’s likely that if he’d not used an LLM to get this work done, it simply wouldn’t have happened, even if someone had been willing to fund a different human to do it.

    Either way, the original point of the post was that LLM-generated code is always shitty (even when it’s not immediately obvious to whoever’s responsible for it that it’s shitty) and so having any amount of it already makes things worse, even ignoring the huge environmental cost. With that context, it is the case that there’s a huge difference between Timmy and Torvalds as Torvalds is famous for having very high standards, so if he’s using it, he might be able to make something that isn’t shitty.



  • Both things are going on at the same time, as Torvalds and Timmy are both paying Sam Altman to pour oil into the river as a byproduct of the service he’s providing. For something as important as the Linux kernel, it wasting fewer CPU cycles as a result of LLM-aided optimisation work might even be net beneficial for the environment once you take into account that it’ll affect billions of computers for years to come. If the end product is shitty, though, there’s no question that it wasn’t worth the environmental damage.