Our tendency toward self-deception can lead us to lie not just about ourselves but about others. The psychologist Melvyn Lerner, for example, identified what he called a "Belief in a Just World"; it feels better to live in a world that seems just than one that seems unjust. Taken to its extreme, that belief can lead people to do things that are downright deplorable, such as blaming innocent victims. Rape victims, for example, are sometimes perceived as if they are to blame, or "had it coming." Perhaps the apotheosis of this sort of behavior occurred during the Irish potato famine, when a rather objectionable English politician said that "the great evil with which we have to contend is not the physical evil of the famine, but the moral evil of the selfish, perverse, and turbulent character of the people." Blaming victims may allow us to cling to the happy notion that the world is just, but its moral costs are often considerable.
A robot that was more sensibly engineered might retain the capacity for deliberative reason but dispense with all the rationalization and self-deception. Such a robot would be aware of its present state but prepared, Buddha-like, to accept it, good or bad, with equanimity rather than agony, and thus choose to take actions based on reality rather than delusion.
In biological terms, the neurotransmitters that underlie emotion, such as dopamine and serotonin, are ancient, tracing their history at least to the first vertebrates and playing a pivotal role in the reflexive systems of animals including fish, birds, and even mammals. Humans, with our massive prefrontal cortex, add substantial reflective reasoning on top, and thus we find ourselves with an instrument-fooling kluge. Virtually every study of reasoned decision making locates this capacity in the prefrontal cortex; emotion is attributed to the limbic system (and oribitofrontal cortex). A spot known as the anterior cingulate, souped up in human beings and other great apes, seems to mediate between the two. Deliberative prefrontal thought is piled
What's the best evidence for this split? Teenagers. Teenagers as a species seem almost pathologically driven by short-term rewards. They make unrealistic estimates of the attendant risks and pay little attention to long-term costs. Why? According to one recent study, the nucleus accumbens, which assesses reward, matures before the orbital frontal cortex, which guides long-term planning and deliberative reasoning. Thus teenagers may have an adult capacity to appreciate short-term gain, but only a child's capacity to recognize long-term risk.
Here again, evolutionary inertia takes precedence over sensible design. Ideally, our judicious system and our reflexive system would mature at comparable rates. But perhaps because of the dynamics of how genomes change, biology tends, on average, to put together the evolutionarily old before the evolutionarily new. The spine, for example, a structure that is shared by all vertebrates, develops before the toes, which evolved more recently. The same thing happens with the brain — the ancestral precedes the modern, which perhaps helps us understand why teens, almost literally, often don't know what to do with themselves. Pleasure, in the context of a system not yet fully wired, can be a dangerous thing. Pleasure giveth, and pleasure taketh away.
7
TH I N GS FALL APART
I can calculate the motion of heavenly bodies but not the madness of people.
— SIR ISAAC NEWTON
ENGINEERS WOULD PROBABLY build kluges more often if it were not for one small fact: that which is clumsy is rarely reliable. Kluges are often (though not always) designed to last for a moment, not a lifetime. On