☆ Yσɠƚԋσʂ ☆

  • 331 Posts
  • 35 Comments
Joined 7 years ago
cake
Cake day: January 18th, 2020

help-circle










  • My point was that the right will always smear the left. What people on the left say is not going to change that one way or the other.

    And I’m quite familiar with how dialectical materialism works having written a whole essay on the subject, which I dare say is a better intro than the wikipedia entry https://dialecticaldispatches.substack.com/p/the-toolset-of-reality

    What I’m saying is that the video doesn’t discuss the mechanics of fascism, but rather how fascists see themselves and the narrative they use to promote their ideology. Understanding that is just as valuable as understanding how fascism function in technical terms.



  • You have absolutely no clue how LLMs work. It’s a neural network generalizes patterns that get imprinted onto it during training. And then these patterns are expressed in the given context during inference. People tend to confuse the output looking similar to training data with the mechanism being simple retrieval. While these agents do not think or feel, describing what they do as storing things in a database and pulling them up later is grossly incorrect. This framing fundamentally misrepresents how LLMs actually store and retrieve information.

    There is no database or a lookup table, and there is no copy of any text they were trained on tucked away somewhere inside the weights. What they have is a compressed statistical model of the patterns that exist across trillions of tokens the text was broken down into. When you ask an LLM a question it does not go find the relevant passage and regurgitate it. What actually happens is that it generates text token by token based on the probability distribution it learned during training. It’s more akin to the way state machines like Markov chains work.

    If anything, the way LLMs work is actually much closer to how humans improvise or combine ideas than to how a search engine or database works. When you write a sentence, you don’t pull up a specific sentence you memorized from a book and copy it. You’ve absorbed the patterns from countless examples of language over your lifetime and internalized them. Writing is a process of generating novel combinations based on those patterns.

    Similarly, the weights of a model encode statistical regularities about word co occurrence, syntactic structures, semantic relationships, and higher level conceptual patterns. When it generates text it is combining those patterns in ways that were never present in the training data. That’s how LLMs produce entirely novel sentences that have never been written before, and why they can be prompted to combine ideas from different domains in creative ways.

    LLMs do reproduce training data verbatim in some cases, but this happens because of overfitting on rare or repeated sequences. When a specific string appears many times in the training data like a famous quote or a common error message the model learns to assign an extremely high probability to each token in that exact sequence. So when it generates it follows the most likely path to reproduce the original text. It is similar to how a human can memorize a song or a poem by hearing it many times but that does not mean our general language ability works by pulling up stored copies from memory.

    The notion that LLM assisted coding is equivalent to ordering from the menu at a restaurant is laughably naive. You seem to think that it’s like a slot machine where you put a query in and then you either get a correct result or some nonsense and you have to try again.

    The way this process actually works is that you start by understanding the problem and figuring out how you want to solve it in terms of architecture, data structures, and algorithms that will be used. Then you get the LLM to come up with a rough shape of the solution, and iterate on it until it works the way you want. In practice, it’s like working with a genetic algorithm.

    The core skill in using these tools is the same as the skill you need when writing code by hand. You have to understand the given requirement, the shape of the solution, and how to verify that the code that was produced actually matches the intent.

    It’s ironic that you talk about AI only copying while uncritically regurgitating nonsense yourself.





  • I disagree they’re taking more power, what changes is the expression of power. During the good times, there’s no need to repress in overt fashion because the working class buys into the narrative. So, some freedoms can be allowed because workers are docile. When there is an economic crisis, the worker unrest starts, and that requires more direct measures to put down. However, the power was always with the ruling class.

    Other systems such as feudalism share aspects with capitalism. There’s no contradiction here. One system evolved out of the other, and necessarily has shared characteristics as a result. Just like socialism retains aspects of capitalist society as well.

    Meanwhile, arguing that these points will somehow be co-opted by the right-wing is a stretch.

    I don’t really see anything anti-Marxist in explaining how the fascist narrative works. Madeline Pendleton clearly has a firm understanding of Marxism, as is clearly evident from her other videos where she talks about theory. The goal of this video was to focus on the narrative that fascists use.






  • Bourgeoisie already have power in any capitalist society because they are the ruling class under capitalism. Fascism is what happens when the mask of liberalism drops and the ruling capitalist class has to resort to naked repression to keep their power. Hence the points she lists are to do with the narrative fascists use to justify the social relations.

















  • I found this app was really helpful getting started https://www.superchinese.com/

    It breaks things up into short lessons, and it has voice recognition so you can practice speaking and see whether you’re pronouncing things correctly. After you get comfortable listening and reciting the phrases a bit, I also recommend watching youtube channels like Lazy Chinese. They break things up by comprehension level, so you can start with beginner, and work your way up. Eventually, it really helps to practice with a native speaker. If you have any classes offered in town or know anybody who speaks Mandarin that’d be willing to help you practice, that’s ultimately how you get to the point where you can really talk to people.

    My advice is not to worry about writing characters to start, and don’t worry too much about tones. They are important, but people will understand you from context most of the time if you get some wrong. It’s also easier to learn tones in the context of a sentence. I still have trouble with tones if I just pronounce an individual word, but when I speak a sentence, I’ve learned to recognize the cadence, so I get them right most of the time now.