• 0 Posts
  • 16 Comments
Joined 3 months ago
cake
Cake day: July 31st, 2026

help-circle




  • Ah, I was worried that there was some local model distro meta that I wasn’t aware of. I have no knowledge of AMD but according to DeepSeek we seem to have somewhat comparable hardware for local LLM. I just noticed the 64GB RAM and figured you’d be on a whole different level, but apparently that setup is in the mid-high tier, spanning from 7-32B? What kind of models have you tried so far, and did any stand out? I’ve only been able to get a 13B Qwen3.5 model as most myself (which was way too slow to be worth it). From what I have picked up >24B is where you get a generally good model that goes beyond a niche purpose.




  • Maybe I’m confused here but if you’re seriously questioning whether you’d benefit from a smaller, Swedish based service over an American tech giant (unsure if this term applies to Discord in all honesty) - for starters you have the Swedish laws/consumer rights, GDPR. This company’s whole idea also seems to resolve around being ‘basically like Discord’ - but without all the aggressive data collection, fingerprinting users, storing messages, and profiting from users data. I also took a quick look at the ToS and PP and it seems pretty solid what their ideals seems to be, or what they want to advertise themselves as. But hey, I bet using a US tech giant company with its entire business model focused on making a profit from user data in the year 2026 is just as good for data privacy respecting laws and regulations as any other!



  • How is switching OS related to local models? Are there any OS that is more efficient? Is there some software that serves certain OS better? I’m curious because I’m also using Mint, have been for about a year now after ditching Windows and I was actually exploring potential benefits of other distros for the first time earlier this week. I’d love to learn if there is something to keep in mind, or is it related to your AMD hardware?







  • I doomscroll Lemmy /and/or my most recent find which I found to be an excellent source for AI/LMM related news that’s actually interesting, hackernews. I also keep a radio plugged in next to my bed, with one of the public service radio channel tuned in 24/7. During the night they usually do reruns of various educational shows that aired during the day, no music, no advertisements, just dull, calm voices speaking about some mildly interesting topics, like gardening tips for example. I lower the volume a bit so I have to really focus if I want to actually listen, otherwise it’s just comfortable noise. It helps a bit with my usual overthinking that usually hits whenever I go to bed.

    I’ve also dabbed my toes in some ASMR and podcasts, and while I found a couple that sort of worked. The tradeoff is that I have to use my phone speakers to listen to anything streamable, which includes me rolling and tossing during the night, and my phone either ends up under me, or has been tossed around so much that I can’t find it by the next morning. Often with a drained battery too, which is just an annoying way to start your day.