Compute Theocracy

From the AI Research Compass wiki

Compute Theocracy: Ring title for extreme Monolith scores: compute is the sole source of capability, and the largest cluster is the closest thing to revelation.

Beliefs

Compute Theocracy is a ring title earned by anyone whose Monolith score exceeds 0.85, the most extreme position on the vertical axis. It turns Compute Statism into faith. Architectures come and go, clever tricks are absorbed, harnesses are dissolved into the weights of the next model; what remains is floating-point operations. Capability is a function of compute, the scaling curve is scripture, and the cluster is the cathedral before which every clever idea is equal, equally irrelevant.

On the chart it crowns the top edge, indifferent to the Language-World axis, since any modality is just more tokens for the furnace. Its orthodox shade reflects that it now defends the mainstream recipe rather than challenging it: the prophets who once preached scale against sceptics have become the established church, and harness-builders and small-model enthusiasts are its heretics.

Arguments

  • Empirical scaling laws show that language model loss falls smoothly and predictably as a power law in compute, data and parameters across many orders of magnitude.
  • Many hand-engineered components, from feature extractors to task-specific heads, have been displaced by larger general models trained with more compute.
  • Predictable returns make compute a plannable investment, which is why it attracts resources at a scale no clever idea can.

Critiques

  • Smooth loss curves do not guarantee smooth gains in the capabilities people care about, and some tasks improve little with scale.
  • Concentrating progress in whoever owns the biggest cluster narrows who can do research and what questions get asked.
  • Data, energy and cost limits mean scaling cannot continue indefinitely, and faith offers no plan for when the curve bends.

Representative works

Relationships

How to get it

Earned in the full or pro test when: Architecture >0.85.

A first draft. Corrections and better arguments are welcome through a pull request. Edit this entry on GitHub Edit its data