

There’s currently a replacement from his own party as the PM, Vučić planned to be the presidential candidate (Putin-Medvedev style switch). IDK about the details (I’m not sure if the Serbian president is appointed by the parliament or by public voting), but basically he’s out of the game. For a while, at least.



This was mostly noticed already in the earliest days of LLM spreading (I think several months since GPT went public), when Russian users noticed it has much worse output in Russian than English. The reason was simply that each letter was treated as a whole distinct token in Russian, leading to more difficulties in outputing words without typos. It is logical that this approach would be more resource-expensive and prone to errors, if the AI has to select each and every letter one by one instead of immediately jumping to selecting words and forming the whole sentence.
English is a fairly analytic language, words barely change, and subtleties in meaning and relationships are expressed with other words. Many other languages encode such information inside the word by various ways of modifying the same base form (inflectional languages). The same way English forms plurals by adding -s, so can other languages add a whole bunch of possible endings to express e.g. that the object is used as a tool, or that it’s the recipient of an action. To analyse and tokenise all that stuff would require decades of manual work. Alternatively I would assume there are some automatised tools that would generally correctly split the words into tokens, at least for the major inflectional languages, such as Russian. But most likely they just split it down to random syllables or even individual letters. Indeed, I just tested Russian, Polish and Croatian in their linked tokenizer, and the results are mostly syllabic or letter-based or just sliced into random sections that don’t correspond to anything linguistically relevant. Not a trace of morphemic analysis (morphemes are meaningful units, e.g. level-head-ed-ness, this style of slicing words down into pieces would probably be the ideal approach here). [Edit: holy shit, it actually seems to treat almost every capital letter as a distinct token.]
Or, to put it most simply, AI bullshits and brute-forces through languages with complicated words. And it’s been known for years. Nice to see additional confirmation, of course, and to learn that they still haven’t improved on it.