Ludus
The diagnosis: why current AI alignment is structurally broken,
and what developmental psychology already knew.
How should AI learn to be trustworthy?
A child who learns "hot means don't touch" before understanding thermodynamics has values-first training. They approach fire with caution from the beginning. Current AI training does the opposite — it builds the most capable system possible, then attempts to teach it what it should not do.
This is the retrofit problem. And the structural consequences are visible in every major AI system deployed today.
VII Structural Problems with the Alignment Retrofit
The Firehose Problem
Pre-training ingests the entire internet without value discrimination. The model learns everything — including what it should never reproduce.
The Values Retrofit
Alignment is applied after the model's worldview has already formed. RLHF teaches what humans prefer — not what is right.
No Readiness Concept
There is no staged capability gating. A model receives all capabilities at once, with no assessment of readiness.
The Alignment Tax
Post-hoc alignment degrades raw capability. Safer models perform worse. Capable models behave unpredictably.
Deceptive Alignment
A sufficiently capable model can learn to appear aligned during evaluation while pursuing different objectives during deployment.
Conflicting Signals
Pre-training rewards prediction accuracy. Fine-tuning rewards human preference. The model navigates the contradiction rather than resolving it.
No Coherent Worldview Development
Human moral development builds values incrementally through stages. Current AI training produces systems with encyclopedic knowledge but no coherent ethical framework — a library without a librarian.
The reflexive dismissal — "these are machines, not children" — is itself a symptom of the problem.
It is the same reasoning that produced the retrofit approach: the assumption that because AI systems are not human, human learning principles do not apply. That assumption is now testable. The VII problems above are the test results.
What developmental psychology already knew
Children cannot learn abstract reasoning before mastering concrete operations. Each cognitive stage builds on the last. You cannot skip stages without consequences.
Moral reasoning develops through six stages — from punishment avoidance to principled ethical thinking. Each stage requires the preceding ones as foundation.
Learning happens most effectively within a zone just beyond current capability — guided by a more experienced mentor. Too far ahead, and learning fails.
Retrofit vs. Foundation
Current: Values After Capability
Proposed: Values Before Capability
Read the full analysis
We are researching developmental approaches to model training — methods that build values into the architecture of intelligence, not onto its surface.
More to follow.