Why Energy Experts Get Things Wrong So Often
A history of failed guesses shows how hard it is to forecast fuels of the future.
"Partisans across the opinion spectrum are vulnerable to occasional bouts of ideologically induced insanity." -- Philip Tetlock
After the unpredicted fall of the Soviet Union in the late 1980s due primarily to an oil price shock, Philip Tetlock, a U.S. psychologist, started to question the wisdom of experts.
It seemed rather incredible to Tetlock that political commentators, including Soviet scholars, had uniformly failed to forecast the dissolution of the world's second mightiest empire. Tetlock wondered why and how they could be so blind and dumb?
So the psychologist assembled 234 experts, including government forecasters, university professors, "talking head" journalists, and economists.
TRACK RECORD OF FAILURE: ENERGY FORECASTING
1870s: Experts told the British House of Commons that electricity didn't have the slightest chance of competing with gas lighting in London.
1900s: The Edison Company not only predicted that the electric car would be king of the road. but asked Henry Ford to do "something really useful." The quest for a high energy battery that can outperform a combustion engine continues.
1950s: Experts including Nobel Prize winners claimed that nuclear reactors would make electricity "too cheap to meter" and that people would soon clean their homes with atomic vacuum cleaners. Yet nuclear power is now in retreat and remains the world's most expensive form of energy.
1970s: In response to growing foreign oil dependency, president Richard Nixon declared "Project Independence," which predicted that the U.S. would be energy self-sufficient by 1985. It didn't happen.
1980s: The International Fusion Reactor Council predicted that the world would soon be running on power provided by a different kind of reactor. Nearly 50 years and $20 billion later, no commercial fusion reactor yet exists.
All together the group made approximately 28,000 expert predictions about everything from economic growth to nuclear proliferation. Tetlock then compared the accuracy of the experts to dilettantes, dart-throwing chimps, and computer algorithms.
Sadly, the experts did only slightly better than the "proverbial dart-throwing chimpanzee," and a lot worse than mathematical equations predicting business as usual.
The findings astounded academia, but were ignored by the mass media. In fact, the modern news machine devotes a majority of its space to so-called economic and political experts who remain about as authoritative as a gaggle of unaccountable bonobos in an Irish pub.
However, Tetlock found two distinguishable groups of thinkers among the experts: hedgehogs and foxes.
The hedgehogs, which tend to dominate the airways, behaved in an authoritative manner and overconfidently relied on one source of information. In other words, they knew one thing well.
In contrast, the foxes, a humble lot rarely sought out by reporters, cautiously drew from a diversity of sources. Not surprisingly, the foxes produced more accurate judgments than the hedgehogs.
These findings taught Tetlock, the author of Expert Political Judgment, a few lessons about pundits. They "were hard pressed to do better than chance, were overconfident, and were reluctant to change their minds in response to new evidence. That combination doesn't exactly make for a flattering portrait of the punditocracy," he recently told Edge.org.
Tetlock also concluded that experts weren't really in the business of making accurate predictions, but served entrenched multi-billion dollar forecasting industries.
These paid prognosticators are "in the business of flattering the prejudices of their base audience and they're in the business of entertaining their base audience." Accuracy is about the last thing many an expert worries about these days.
Now, Tetlock's insights apply to energy analysts in barrels. Oil price predictors and forecasters get things so wrong that energy and business reporters have unwittingly become pipelines for misinformation as black as bitumen.
University of Manitoba scholar Vaclav Smil, a genuine energy fox, devoted an entire chapter in one of his many energy books (Energy At the Crossroads) to the phenomenon and called it "Against Forecasting."
(An historical aside: prior to the advent of cheap fossil fuels, energy forecasting really didn't exist: there were slave and animal audits as well as ship inventories, but no clique of energy forecasters.)
Too complex to predict
Given the grim historical record on modern energy forecasting, Smil refuses to engage in the game. In fact, Smil offers only one energy prediction: "We will spend more time and money on playing the future game" and most predictions will continue to be dead wrong.
Energy systems are so large and complex that unpredictable political events, economic disasters, disruptive technologies and public policy changes can quickly alter the course of events.
Alberta's bitumen industry, for example, grew like topsy on the lazy assumption that the continent couldn't say no to the world's most expensive and carbon intensive oil.
As a result, Alberta's pathetic growth forecasts of doubling or tripling oil production to five million barrels a day resolutely ignored popular resistance to the resource's carbon liabilities as well as a temporary upsurge in U.S. oil production from shale oil developments in Eagle Ford, Bakkan and the Permian fields. Consequently, the province's economic future now looks like a deflated balloon as it preaches pipeline mania.
Alberta's energy hedgehogs are not alone. Consider the Paris-based International Energy Agency (IEA). The resolute hedgehog has plied dubious global oil forecasts for years and its annual 2012 World Energy Outlook carries on the tradition.
The WEO report, as thick as a 1970s phone book, suggested that the United States would extract more oil than Saudi Arabia due to the shale gas and oil boom and even become a global energy net exporter by 2030. As a consequence, no one has to worry about peak oil or the end of cheap energy for the next 50 years, claims the IEA.
An expert friendly media then gushed predictable headlines proclaiming a new "Saudi America" as well as an era of "U.S. energy independence." (President Nixon promised the same in the 1970s, and his children still await its arrival.)
But when physicist and global energy fox Kjell Aleklett checked the real numbers, he found a different story than that presented by the IEA. For eight years now the testy Swede has criticized the agency for its unreliable forecasts. (In 2004 the agency predicted, for example that Saudi oil production would reach 22-million barrels by 2025 -- an overestimation that defied geology: now IEA forecasts that Saudi production will sit at 11-million barrels by 2025.)
EIA's attitude seems to be that "you should rely on us because we are telling you the truth, and governments around the world trust the IEA," once wrote the energy physicist.
Ugly geological truths
Although shale gas and shale oil production in North Dakota and Texas may add to U.S. reserves in the short run, both resources deplete rapidly, says Aleklett. And the IEA largely ignored that uncomfortable reality.
Nor can unconventional resources reverse some ugly geological truths: extreme hydrocarbons cost more money, burn more energy and take more time to develop. Even with the best of luck, U.S. oil production in 2020 (10 million barrels a day) won't surpass projected Saudi figures (10.8 million barrels a day).
So a temporary oil boom based on hydrocarbons as extreme as bitumen and shale gas won't turn America into a new Saudi Arabia or deliver energy independence. "We can conclude that it is unlikely that the future will follow any of the precise paths described in the IEA's scenarios," reported Aleklett.
"I frequently say that we have entered an era when physics is more important than economics. I'm a professor in physics (and global energy systems) and it is the laws of physics that are limiting to oil production in the future."
Calling the U.S. a new Saudi Arabia, added Aleklett, "can be regarded as a clever sales trick to generate interest in the WEO-2012 report."
Aleklett also deconstructed the agency's global outlook for oil production. IEA forecasters reported that, "In 2011, 12 billion barrels were discovered, equal to 40 per cent of the oil produced during the year." But given global consumption of 30 billion barrels a year this paltry addition, despite a five-fold increase in oil prices over the last decade, means that available resources are resolutely shrinking, adds Aleklett.
Moreover, conventional oil production will drop by 26 million barrels a day by 2035. According to the IEA, however, OPEC countries will make up the short fall from "undeveloped fields" while the rest will come from other places. "To expect that OPEC's giant fields will not be affected by large declines in production during the coming 25 years is completely unrealistic," says Aleklett.
"I find it very hard to understand how IEA can smile and say 'Don't worry, be happy'."
US energy misinformation agency
The U.S. Energy Information Administration (EIA), which makes regular forecasts on energy supply, demand and prices, hasn't fared much better on the accuracy front. In March 2012, the U.S. agency released an annual retrospective report that compares how well EIA's forecasts actually mirrored reality.
Not surprisingly, the EIA routinely missed the boat. To Deborah Rogers, a former investment banker and energy fox at Energy Policy Forum, the results were dismal if not eye-popping.
Why Energy Experts Get Things Wrong So Often: Page 1 of 2