Visualism

From the AI Research Compass wiki

Visualism: Believes vision is the primary substrate of intelligence, and that language merely names what visual understanding already knows.

Beliefs

Visualism makes the bold version of the perceptual claim. Long before any animal had words, it could see: find food, avoid predators, judge distances, recognize kin. Language arrived late and attached labels to categories that vision had already carved out. So the path to intelligence runs through vision first. Scale visual models on enough images and video, let them learn sequential structure in pixels the way language models learned it in tokens, and general capabilities will follow, no linguistic crutch required.

It sits at the far World edge, near the top: a single large visual model, not a stack of modules. Its paradigm level is Revolutionary. It rejects the reigning assumption that language models are the center of AI and proposes that vision is the larger, older and richer foundation on which everything else, including language, is built.

Arguments

  • Evolution suggests vision preceded and scaffolds language; much of human cognition is spatial and perceptual rather than verbal.
  • Large vision models trained only on images and video, cast as sequence prediction, show in-context abilities without any text.
  • The supply of visual data dwarfs high-quality text, so vision offers more room to scale when text runs short.

Critiques

  • Language-first camps reply that the most impressive general abilities so far came from text, not pixels.
  • Visual data is highly redundant; more frames do not necessarily mean more knowledge per unit of compute.
  • Without language, it is hard to specify tasks, evaluate abstract reasoning or communicate results to people.

Representative works

Relationships

How to get it

Land on this cell in the full or pro test: x ≈ +1.00, y ≈ +0.64, paradigm ≈ +0.41.

A first draft. Corrections and better arguments are welcome through a pull request. Edit this entry on GitHub Edit its data