Logdyco

Evolved antennas, LLM-generated code, and a potential antifuture – Eric Bailey

LLM companies are continuing to operate at a loss. The real cost of using their services may manifest sooner than later, as promises of profitability need to be kept.

On le redoute, mais il n'arrive pas encore. Mais on le redoute au fond de nous.

This LLM optimization might even go a step further. In the pursuit of efficiency its code output becomes a language completely decoupled from a human’s ability to follow. [...] Or there is a dictionary, but it is sold back to you at a premium.

Fini les commmentaires inutiles dans le code. Il faudrait quand même que le code soit suffisament expressif. D'où la notion de dictionnaire propriétaire. OK.

Some here may argue that these systems are performing better than how human developers have, and that will increase as LLM-generated code becomes more prevalent. Here, know that:

  • As of now, homepage accessibility errors and complexity are both on the rise, and
  • This increase in inaccessible code will continue to be enshrined, codified, and amplified as the source code is re-scraped and fed back into model data training efforts.

Les graphes en lien ne me semblent pas encore si significatifs que ça. Mais l'idée reste tout à fait plausible, bien que pas nécessairement insoluble (modèles améliorés dans ce sens par ex.). Je ne suis pas sur qu'Internet servent encore de source pour les LLMs, maintenant qu'il est complètement pollué de contenus générés par LLMs (Model Collapse).

The lifespan of these [Internet and open source] ideas are also tiny blips compared to the centuries of traditional power structures and systems that came before them. It’s also enough time for said structures and systems to figure out how to address these existential threats and return things to how they prefer to operate.

Un maximum local de liberté, rapidement dépassé par une heuristique pour redescendre vers un maximum global de contrôle.

Here, know that I am not feeling fear as much as anger and a desire to preserve what is boring and works.

Je viens du monde chiant, c'est pas si mal.

Extraits cités issus de ce lien visité le , crédits: Eric W. Bailey