books

Range

by David Epstein

82 passages marked

Cover of Range

I was stunned when cognitive psychologists I spoke with led me to an enormous and too often ignored body of work demonstrating that learning itself is best done slowly to accumulate lasting knowledge, even when that means performing poorly on tests of immediate progress. That is, the most effective learning looks inefficient; it looks like falling behind.

Overspecialization can lead to collective tragedy even when every individual separately takes the most reasonable course of action.

Highly specialized health care professionals have developed their own versions of the “if all you have is a hammer, everything looks like a nail” problem.

increasing specialization has created a “system of parallel trenches” in the quest for innovation.

The challenge we all face is how to maintain the benefits of breadth, diverse experience, interdisciplinary thinking, and delayed concentration in a world that increasingly incentivizes, even demands, hyperspecialization.

While it is undoubtedly true that there are areas that require individuals with Tiger’s precocity and clarity of purpose, as complexity increases—as technology spins the world into vaster webs of interconnected systems in which each individual only sees a small part—we also need more Rogers: people who start broad and embrace diverse experiences and perspectives while they progress. People with range.

the school system was frustratingly one-size-fits-all, made for producing “the gray average mass,” as Laszlo put it.

In 1972, the year before Susan started training, American Bobby Fischer defeated Russian Boris Spassky in the “Match of the Century.”

He spent his extra time cutting two hundred thousand records of game sequences from chess journals—many offering a preview of potential opponents—and filing them in a custom card catalog, the “cartotech.” Before computer chess programs, it gave the Polgars the largest chess database in the world to study outside of—maybe—the Soviet Union’s secret archives.

In January 1991, at the age of twenty-one, Susan became the first woman to achieve grandmaster status through tournament play against men.

In December, Judit, at fifteen years and five months, became the youngest grandmaster ever, male or female.

When Susan was asked on television if she wanted to win the world championship in the men’s or women’s category, she cleverly responded that she wanted to win the “absolute category.”

Psychologist Gary Klein is a pioneer of the “naturalistic decision making” (NDM) model of expertise; NDM researchers observe expert performers in their natural course of work to learn how they make high-stakes decisions under time pressure.

Klein has shown that experts in an array of fields are remarkably similar to chess masters in that they instinctively recognize familiar patterns.

When I asked Garry Kasparov, perhaps the greatest chess player in history, to explain his decision process for a move, he told me, “I see a move, a combination, almost instantly,” based on patterns he has seen before. Kasparov said he would bet that grandmasters usually make the move that springs to mind in the first few seconds of thought.

Klein studied firefighting commanders and estimated that around 80 percent of their decisions are also made instinctively and in seconds. After years of firefighting, they recognize repeating patterns in the behavior of flames and of burning buildings on the verge of collapse.

One of Klein’s colleagues, psychologist Daniel Kahneman, studied human decision making from the “heuristics and biases” model of human judgment.

When Kahneman probed the judgments of highly trained experts, he often found that experience had not helped at all. Even worse, it frequently bred confidence but not skill.

Kahneman included himself in that critique. He first began to doubt the link between experience and expertise in 1955, as a young lieutenant in the psychology unit of the Israel Defense Forces.

In those domains, which involved human behavior and where patterns did not clearly repeat, repetition did not cause learning. Chess, golf, and firefighting are exceptions, not the rule.

The domains Klein studied, in which instinctive pattern recognition worked powerfully, are what psychologist Robin Hogarth termed “kind” learning environments.

In wicked domains, the rules of the game are often unclear or incomplete, there may or may not be repetitive patterns and they may not be obvious, and feedback is often delayed, inaccurate, or both.

In a 1997 showdown billed as the final battle for supremacy between natural and artificial intelligence, IBM supercomputer Deep Blue defeated Garry Kasparov. Deep Blue evaluated two hundred million positions per second. That is a tiny fraction of possible chess positions—the number of possible game sequences is more than atoms in the observable universe—but plenty enough to beat the best human. According to Kasparov, “Today the free chess app on your mobile phone is stronger than me.” He is not being rhetorical.

“Anything we can do, and we know how to do it, machines will do it better,” he said at a recent lecture. “If we can codify it, and pass it to computers, they will do it better.” Still, losing to Deep Blue gave him an idea. In playing computers, he recognized what artificial intelligence scholars call Moravec’s paradox: machines and humans frequently have opposite strengths and weaknesses.

A duo of amateur players with three normal computers not only destroyed Hydra, the best chess supercomputer, they also crushed teams of grandmasters using computers.

Human/Computer combo teams—known as “centaurs”—were playing the highest level of chess ever seen.

That test reenacted an experiment from 1973, in which two Carnegie Mellon University psychologists, William G. Chase and soon-to-be Nobel laureate Herbert A. Simon, repeated the De Groot exercise, but added a wrinkle. This time, the chess players were also given boards with the pieces in an arrangement that would never actually occur in a game. Suddenly, the experts performed just like the lesser players. The grandmasters never had photographic memories after all. Through repetitive study of game patterns, they had learned to do what Chase and Simon called “chunking.”

Chunking helps explain instances of apparently miraculous, domain-specific memory, from musicians playing long pieces by heart to quarterbacks recognizing patterns of players in a split second and making a decision to throw. The reason that elite athletes seem to have superhuman reflexes is that they recognize patterns of ball or body movements that tell them what’s coming before it happens. When tested outside of their sport context, their superhuman reactions disappear.

For more than fifty years, psychiatrist Darold Treffert studied savants, individuals with an insatiable drive to practice in one domain, and ability in that area that far outstrips their abilities in other areas. “Islands of genius,” Treffert calls it.* Treffert documented the almost unbelievable feats of savants like pianist Leslie Lemke, who can play thousands of songs from memory.

Because Lemke and other savants have seemingly limitless retrieval capacity, Treffert initially attributed their abilities to perfect memories; they are human tape recorders. Except, when they are tested after hearing a piece of music for the first time, musical savants reproduce “tonal” music—the genre of nearly all pop and most classical music—more easily than “atonal” music, in which successive notes do not follow familiar harmonic structures.

If savants were human tape recorders playing notes back, it would make no difference whether they were asked to re-create music that follows popular rules of composition or not. But in practice, it makes an enormous difference.

With the advances made by the AlphaZero chess program (owned by an AI arm of Google’s parent company), perhaps even the top centaurs would be vanquished in a freestyle tournament.

Unlike previous chess programs, which used brute processing force to calculate an enormous number of possible moves and rate them according to criteria set by programmers, AlphaZero actually taught itself to play. It needed only the rules, and then to play itself a gargantuan number of times, keeping track of what tends to work and what doesn’t, and using that to improve. In short order, it beat the best chess programs. It did the same with the game of Go, which has many more possible positions. But the centaur lesson remains: the more a task shifts to an open world of big-picture strategy, the more humans have to add.

Our greatest strength is the exact opposite of narrow specialization. It is the ability to integrate broadly.

“The difference between winning at Jeopardy! and curing all cancer is that we know the answer to Jeopardy! questions.” With cancer, we’re still working on posing the right questions in the first place.

“AI systems are like savants.” They need stable structures and narrow worlds.

When we know the rules and answers, and they don’t change over time—chess, golf, playing classical music—an argument can be made for savant-like hyperspecialized practice from day one. But those are poor models of most things humans want to learn.

The world is not golf, and most of it isn’t even tennis. As Robin Hogarth put it, much of the world is “Martian tennis.” You can see the players on a court with balls and rackets, but nobody has shared the rules. It is up to you to derive them, and they are subject to change without notice.

When experienced accountants were asked in a study to use a new tax law for deductions that replaced a previous one, they did worse than novices. Erik Dane, a Rice University professor who studies organizational behavior, calls this phenomenon “cognitive entrenchment.”

“To him who observes them from afar,” said Spanish Nobel laureate Santiago Ramón y Cajal, the father of modern neuroscience, “it appears as though they are scattering and dissipating their energies, while in reality they are channeling and strengthening them.”

As psychologist and prominent creativity researcher Dean Keith Simonton observed, “rather than obsessively focus[ing] on a narrow topic,” creative achievers tend to have broad interests. “This breadth often supports insights that cannot be attributed to domain-specific expertise alone.”

Those findings are reminiscent of a speech Steve Jobs gave, in which he famously recounted the importance of a calligraphy class to his design aesthetics. “When we were designing the first Macintosh computer, it all came back to me,” he said. “If I had never dropped in on that single course in college, the Mac would have never had multiple typefaces or proportionally spaced fonts.”

electrical engineer Claude Shannon, who launched the Information Age thanks to a philosophy course he took to fulfill a requirement at the University of Michigan. In it, he was exposed to the work of self-taught nineteenth-century English logician George Boole, who assigned a value of 1 to true statements and 0 to false statements and showed that logic problems could be solved like math equations. It resulted in absolutely nothing of practical importance until seventy years after Boole passed away, when Shannon did a summer internship at AT& T’s Bell Labs research facility. There he recognized that he could combine telephone call-routing technology with Boole’s logic system to encode and transmit any type of information electronically. It was the fundamental insight on which computers rely. “It just happened that no one else was familiar with both those fields at the same time,” Shannon said.

Connolly’s primary finding was that early in their careers, those who later made successful transitions had broader training and kept multiple “career streams” open even as they pursued a primary specialty. They “traveled on an eight-lane highway,” he wrote, rather than down a single-lane one-way street. They had range. The successful adapters were excellent at taking knowledge from one pursuit and applying it creatively to another, and at avoiding cognitive entrenchment.

They employed what Hogarth called a “circuit breaker.” They drew on outside experiences and analogies to interrupt their inclination toward a previous solution that may no longer work. Their skill was in avoiding the same old patterns. In the wicked world, with ill-defined challenges and few rigid rules, range can be a life hack.

James Flynn, a professor of political studies who changed how psychologists think about thinking.

The data were from a test known as Raven’s Progressive Matrices, designed to gauge the test taker’s ability to make sense of complexity. Each question of the test shows a set of abstract designs with one design missing. The test taker must try to fill in the missing design to complete a pattern. Raven’s was conceived to be the epitome of a “culturally reduced” test; performance should be unaffected by material learned in life, inside or outside of school. Should Martians alight on Earth, Raven’s should be the test capable of determining how bright they are. And yet Flynn could immediately see that young Dutchmen had made enormous gains from one generation to the next.

IQ tests are all standardized so that the average score is always 100 points. (They are graded based on a curve, with 100 in the middle.) Flynn noticed that the tests had to be restandardized from time to time to keep the average at 100, because test takers were giving more correct answers than they had in the past.

Flynn collected data from fourteen countries. Every single one showed huge gains for both children and adults. “Our advantage over our ancestors,” as he put it, is “from the cradle to the grave.”

“As an outsider,” Flynn told me, “things strike me as surprising that I think people trained in psychometrics just accepted.”

The Flynn effect—the increase in correct IQ test answers with each new generation in the twentieth century—has now been documented in more than thirty countries. The gains are startling: three points every ten years. To put that in perspective, if an adult who scored average today were compared to adults a century ago, she would be in the 98th percentile.

In 1931, amid that incredible transformation, a brilliant young Russian psychologist named Alexander Luria recognized a fleeting “natural experiment,” unique in the history of the world. He wondered if changing citizens’ work might also change their minds.

premodern people miss the forest for the trees; modern people miss the trees for the forest.

The more they had moved toward modernity, the more powerful their abstract thinking, and the less they had to rely on their concrete experience of the world as a reference point.

In Flynn’s terms, we now see the world through “scientific spectacles.” He means that rather than relying on our own direct experiences, we make sense of reality through classification schemes, using layers of abstract concepts to understand how pieces of information relate to one another.

The word “percent” was almost absent from books in 1900. By 2000 it appeared about once every five thousand words.

the Flynn effect has proceeded more slowly for women than for men in the same community. Exposure to the modern world has made us better adapted for complexity, and that has manifested as flexibility, with profound implications for the breadth of our intellectual world.

In every cognitive direction, the minds of premodern citizens were severely constrained by the concrete world before them.

As Arab historiographer Ibn Khaldun, considered a founder of sociology, pointed out centuries ago, a city dweller traveling through the desert will be completely dependent on a nomad to keep him alive. So long as they remain in the desert, the nomad is a genius.

“[It] is usually quite flexible,” Luria wrote. “Subjects readily shift from one attribute to another and construct suitable categories. They classify objects by substance (animals, flowers, tools), materials (wood, metal, glass), size (large, small), and color (light, dark), or other property. The ability to move freely, to shift from one category to another, is one of the chief characteristics of ‘abstract thinking.’”

Flynn’s conclusion: “There is no sign that any department attempts to develop [anything] other than narrow critical competence.”

Their education is too narrow.” He does not mean this in the simple sense that every computer science major needs an art history class, but rather that everyone needs habits of mind that allow them to dance across disciplines.

if students are to capitalize on their unprecedented capacity for abstract thought. They must be taught to think before being taught what to think about.

Students come prepared with scientific spectacles, but do not leave carrying a scientific-reasoning Swiss Army knife.

Jeannette Wing, a computer science professor at Columbia University and former corporate vice president of Microsoft Research, has pushed broad “computational thinking” as the mental Swiss Army knife. She advocated that it become as fundamental as reading, even for those who will have nothing to do with computer science or programming. “Computational thinking is using abstraction and decomposition when attacking a large complex task,” she wrote. “It is choosing an appropriate representation for a problem.”

Three-quarters of American college graduates go on to a career unrelated to their major—a trend that includes math and science majors—after having become competent only with the tools of a single discipline.

As the historian and philosopher Arnold Toynbee said when he described analyzing the world in an age of technological and social change, “No tool is omnicompetent.”

As statistician Doug Altman put it, “Everyone is so busy doing research they don’t have time to stop and think about the way they’re doing it.”

The professor later explained that these were “Fermi problems,” because Enrico Fermi—who created the first nuclear reactor beneath the University of Chicago football field—constantly made back-of-the-envelope estimates to help him approach problems.* The ultimate lesson of the question was that detailed prior knowledge was less important than a way of thinking.

The more constrained and repetitive a challenge, the more likely it will be automated, while great rewards will accrue to those who can take conceptual knowledge from one problem or domain and apply it in an entirely new one.

Instrumental music—music that did not depend on words—underwent a complete revolution. Some of the instruments were brand-new, like the piano; others were enhanced—violins made by Antonio Stradivari would sell centuries later for millions of dollars.

Parents, Yates told me, increasingly come to him and “want their kids doing what the Olympians are doing right now, not what the Olympians were doing when they were twelve or thirteen,” which included a wider variety of activities that developed their general athleticism and allowed them to probe their talents and interests before they focused narrowly on technical skills. The sampling period is not incidental to the development of great performers—something to be excised in the interest of a head start—it is integral.

John Sloboda is undoubtedly one of the most influential researchers in the psychology of music. His 1985 book The Musical Mind ranged from the origins of music to the acquisition of playing skill, and set a research agenda that the field is still carrying out today.

In 1998, alongside Sir Edmund Hillary, who with Tenzing Norgay was the first to summit Mount Everest, Smith was awarded Smithsonian’s Bicentennial Medal for outstanding cultural contributions.

Charles Limb, a musician, hearing specialist, and auditory surgeon at the University of California, San Francisco, designed an iron-free keyboard so that jazz musicians could improvise while inside an MRI scanner. Limb saw that brain areas associated with focused attention, inhibition, and self-censoring turned down when the musicians were creating. “It’s almost as if the brain turned off its own ability to criticize itself,” he told National Geographic. While improvising, musicians do pretty much the opposite of consciously identifying errors and stopping to correct them.

Improv masters learn like babies: dive in and imitate and improvise first, learn the formal rules later. “At the beginning, your mom didn’t give you a book and say, ‘This is a noun, this is a pronoun, this is a dangling participle,’” Cecchini told me. “You acquired the sound first. And then you acquire the grammar later.”

One of those desirable difficulties is known as the “generation effect.” Struggling to generate an answer on your own, even a wrong one, enhances subsequent learning.

Socrates was apparently on to something when he forced pupils to generate answers rather than bestowing them. It requires the learner to intentionally sacrifice current performance for future benefit.

Metcalfe and colleagues have repeatedly demonstrated a “hypercorrection effect.” The more confident a learner is of their wrong answer, the better the information sticks when they subsequently learn the right answer. Tolerating big mistakes can create the best learning opportunities.*

Short-term rehearsal gave purely short-term benefits. Struggling to hold on to information and then recall it had helped the group distracted by math problems transfer the information from short-term to long-term memory. The group with more and immediate rehearsal opportunity recalled nearly nothing on the pop quiz. Repetition, it turned out, was less important than struggle.

For a given amount of material, learning is most efficient in the long run when it is really inefficient in the short run.

Frustration is not a sign you are not learning, but ease is.

← all highlights · 82 passages · Range