51 Ways to Spell the Image Giraffe:
media.ccc.de
Generative AI models don't operate on human languages – they speak in **tokens**. Tokens are computational fragments that deconstruct lan...
  • MonaySimpson@lemmy.mlEnglish
    7·
    4 months ago

    Dominated by popular culture, brands, platform-speak, and non-words. Tokenization is, therefore, a political act: it defines what can be represented and how the world becomes computationally representable.

    Welcome to 1984