You're now on the archive server. Commenting has been disabled.

Guest Post: Is It Models Or The Economists? Statement By David Colander

Tyler Durden's picture




Submitted by Chris Whalen of Institutional Risk Analytics

"You won't get gun control by disarming law-abiding citizens. There's only one way to get real gun control: disarm the thugs and the criminals, lock them up, and if you don't actually throw away the key, at least lose it for a long time... It's a nasty truth, but those who seek to inflict harm are not fazed by gun controllers. I happen to know this from personal experience."

Ronald Reagan, 1983

First, two housekeeping notes. IRA co-founder Christopher Whalen and Josh Rosner of Graham-Fisher & Co. are making a presentation to the New York Chapter of the Risk Management Association on Wednesday, September 23, 2009. Click the hyperlink for details: http://www.rmany.org/vcart/mtgreg.asp

On Friday of this week, Whalen will be participating in the twelfth annual International Banking Conference at the Federal Reserve Bank of Chicago. Our panel is Session VI: "How to Make Regulators and Government More Accountable: Regulatory Governance and Agency Design." We are looking forward to an interesting discussion with Edward J. Kane, Boston College Michael Klein, formerly with The World Bank, and Ross Levine, Brown University.

When we appeared before the House Science and Technology Committee last month, the final witness, David Colander of Middlebury College, was easily the most interesting speaker of the day. He addressed the financial crisis from the perspective of how models or really just one model has developed in the economics community due to a lack of diversity and rigor in basic economic research.

He also addressed the monopoly that these economists exercise on new research and publication, and thus tenure, in universities. Dr. Colander challenged the Committee to change the way in which the National Science Foundation allocates funds for grants to support economic research and suggested other reforms to the economics profession that would restore some semblance of scientific discipline to a community that is deeply involved with the formulation of national policy.

Dr. Colander's testimony is reproduced below with his permission. We included two footnotes in italics. His text plus other attachments are available in the full testimony on the committee web site.

Testimony of David Colander
Submitted to the Congress of the United States, House Science and Technology Committee
for the Hearing: "The Risks of Financial Modeling: VaR and the Economic Meltdown."
September 10, 2009

Introduction

One year ago, almost to the day, the U.S. economy had a financial heart attack, from which it is still recovering. That heart attack, like all heart attacks, was a shock, and it has caused much discussion about who is to blame, and how can we avoid such heart attacks in the future. In my view much of that discussion has been off point. To make an analogy to a physical heart attack, the US had a heart attack because it is the equivalent of a 450-pound man with serious ailments too numerous to list, who is trying to live as if he were still a 20 year old who can party 24-7. It doesn't take a rocket economist to know that that will likely lead to trouble. The questions I address in my testimony are: Why didn't rocket economists recognize that, and warn society about it? And: What changes can be made to see that it doesn't happen in the future?

Some non-economists have blamed the financial heart attack on economist's highly technical models. In my view the problem is not the models; the problem is the way economic models are used. All too often models are used in lieu of educated common sense, when in fact models should be used as an aid to educated common sense. When models replace common sense, they are a hindrance rather than a help.

Modeling the Economy as a Complex System

Using models within economics or within any other social science, is especially treacherous. That's because social science involves a higher degree of complexity than the natural sciences. The reason why social science is so complex is that the basic unit in social science, which economists call agents, are strategic, whereas the basic unit of the natural sciences are not. Economics can be thought of the physics with strategic atoms, who keep trying to foil any efforts to understand them and bring them under control. Strategic agents complicate modeling enormously; they make it impossible to have a perfect model since they increase the number of calculations one would have to make in order to solve the model beyond the calculations the fastest computer one can hypothesize could process in a finite amount of time.

Put simply, the formal study of complex systems is really, really, hard. Inevitably, complex systems exhibit path dependence, nested systems, multiple speed variables, sensitive dependence on initial conditions, and other non-linear dynamical properties. This means that at any moment in time, right when you thought you had a result, all hell can break loose. Formally studying complex systems requires rigorous training in the cutting edge of mathematics and statistics. It's not for neophytes.

This recognition that the economy is complex is not a new discovery. Earlier economists, such as John Stuart Mill, recognized the economy's complexity and were very modest in their claims about the usefulness of their models. They carefully presented their models as aids to a broader informed common sense. They built this modesty into their policy advice and told policy makers that the most we can expect from models is half-truths. To make sure that they did not claim too much for their scientific models, they divided the field of economics into two branches-one a scientific branch, which worked on formal models, and the other political economy, which was the branch of economics that addressed policy. Political economy was seen as an art which did not have the backing of science, but instead relied on the insights from models developed in the scientific branch supplemented by educated common sense to guide policy prescriptions.

In the early 1900s that two-part division broke down, and economists became a bit less modest in their claims for models, and more aggressive in their application of models directly to policy questions. The two branches were merged, and the result was a tragedy for both the science of economics and for the applied policy branch of economics.

It was a tragedy for the science of economics because it led economists away from developing a wide variety of models that would creatively explore the extraordinarily difficult questions that the complexity of the economy raised, questions for which new analytic and computational technology opened up new avenues of investigation. Instead, the economics profession spent much of its time dotting i's and crossing t's on what was called a Walrasian general equilibrium model which was more analytically tractable. As opposed to viewing the supply/demand model and its macroeconomic counterpart, the Walrasian general equilibrium model, as interesting models relevant for a few limited phenomena, but at best a stepping stone for a formal understanding of the economy, it enshrined both models, and acted as if it explained everything. Complexities were just assumed away not because it made sense to assume them away, but for tractability reasons. The result was a set of models that would not even pass a perfunctory common sense smell test being studied ad nauseam.

Some approaches working outside this Walrasian general equilibrium framework that I see as promising includes approaches using adaptive network analysis, agent based modeling, random graph theory, ultrametrics, combinatorial stochastic processes, cointegrated vector autoregression, and the general study of non-linear dynamic models.

Initially macroeconomics stayed separate from this broader unitary approach, and relied on a set of rough and ready models that had little scientific foundation. But in the 1980s, macroeconomics and finance fell into this "single model" approach. As that happened it caused economists to lose sight of the larger lesson that complexity conveys -that models in a complex system can be expected to continually break down. This adoption by macroeconomists of a single-model approach is one of the reasons why the economics profession failed to warn society about the financial crisis, and some parts of the profession assured society that such a crisis could not happen. Because they focused on that single model, economists simply did not study and plan for the inevitable breakdown of systems that one would expect in a complex system, because they had become so enamored with their model that they forgot to use it with common sense judgment.

Models and Macroeconomics

Let me be a bit more specific. The dominant model in macroeconomics is the dynamic stochastic general equilibrium (DSGE) model. This is a model that assumes there is a single globally rational representative agent with complete knowledge who is maximizing over the infinite future. In this model, by definition, there can be no strategic coordination problem-the most likely cause of the recent crisis-such problems are simply assumed away. Yet, this model has been the central focus of macro economists' research for the last thirty years.

Had the DSGE model been seen as an aid to common sense, it could have been a useful model. When early versions of this model first developed back in the early 1980s, it served the useful purpose of getting some intertemporal issues straight that earlier macroeconomic models had screwed up. But then, for a variety of sociological reasons that I don't have time to go into here, a majority of macroeconomists started believing that the DSGE model was useful not just as an aid to our understanding, but as the model of the macroeconomy. That doesn't say much for the common sense of rocket economists. As the DSGE model became dominant, important research on broader non-linear dynamic models of the economy that would have been more helpful in understanding how an economy would be likely to crash, and what government might do when faced with a crash, was not done.

Among well known economists, Robert Solow stands out in having warned about the use of DSGE models for policy. (See Solow, in Colander, 2007, pg 235.) He called them "rhetorical swindles." Other economists, such as Post Keynesians, and economic methodologists also warned about the use of these models. For a discussion of alternative approaches, see Colander, ed. (2007). So alternative approaches were being considered, and concern about the model was aired, but those voices were lost in the enthusiasm most of the macroeconomics community showed for these models.

Similar developments occurred with efficient market finance models, which make similar assumptions to DSGE models. When efficient market models first developed, they were useful; they led to technological advances in risk management and financial markets. But, as happened with macro, the users of these financial models forgot that models provide at best half truths; they stopped using models with common sense and judgment. The modelers knew that there was uncertainty and risk in these markets that when far beyond the risk assumed in the models. Simplification is the nature of modeling. But simplification means the models cannot be used directly, but must be used judgment and common sense, with a knowledge of the limitations of use that the simplifications require. Unfortunately, the warning labels on the models that should have been there in bold print-these models are based on assumptions that do not fit the real world, and thus the models should not be relied on too heavily-were not there. They should have been, which is why in the Dahlem Report we suggested that economic researchers who develop these models be subject to a code of ethics that requires them to warn society when economic models are being used for purposes for which they were not designed.

How did something so stupid happen in economics? It did not happen because economists are stupid; they are very bright. It happened because of incentives in the academic profession to advance lead researchers to dot i's and cross t's of existing models, rather than to explore a wide range of alternative models, or to focus their research on interpreting and seeing that models are used in policy with common sense. Common sense does not advance one very far within the economics profession. The over-reliance on a single model used without judgment is a serious problem that is built into the institutional structure of academia that produces economic researchers. That system trains show dogs, when what we need are hunting dogs.

The incorrect training starts in graduate school, where in their core courses students are primarily trained in analytic techniques useful for developing models, but not in how to use models creatively, or in how to use models with judgment to arrive at policy conclusions. For the most part policy issues are not even discussed in the entire core macroeconomics course. As students at a top graduate school said, "Monetary and fiscal policy are not abstract enough to be a question that would be answered in a macro course" and "We never talked about monetary or fiscal policy, although it might have been slipped in as a variable in one particular model." (Colander, 2007, pg 169).

Suggestions

Let me conclude with a brief discussion of two suggestions, which relate to issues under the jurisdiction of this committee, that might decrease the probability of such events happening in the future.

Include a wider range of peers in peer review

The first is a proposal that might help add a common sense check on models. Such a check is needed because, currently, the nature of internal-to-the-subfield peer review allows for an almost incestuous mutual reinforcement of researcher's views with no common sense filter on those views. The proposal is to include a wider range of peers in the reviewing process of NSF grants in the social sciences. For example, physicists, mathematician, statisticians, and even business and governmental representatives, could serve, along with economists, on reviewing committees for economics proposals. Such a broader peer review process would likely both encourage research on much wider range of models and would also encourage more creative work.

Increase the number of researchers trained to interpret models

The second is a proposal to increase the number of researchers trained in interpreting models rather than developing models by providing research grants to do that. In a sense, what I am suggesting is an applied science division of the National Science Foundation's social science component. This division would fund work on the usefulness of models, and would be responsible for adding the warning labels that should have been attached to the models.

This applied research would not be highly technical and would involve a quite different set of skills than the standard scientific research would require. It would require researchers who had an intricate consumer's knowledge of theory but not a producer's knowledge. In addition it would require a knowledge of institutions, methodology, previous literature, and a sensibility about how the system works. These are all skills that are currently not taught in graduate economics programs, but they are the skills that underlie judgment and common sense. By providing NSF grants for this work, the NSF would encourage the development of a group of economists who specialized in interpreting models and applying models to the real world. The development of such a group would go a long way toward placing the necessary warning labels on models, and make it less likely that fiascos like a financial crisis would happen again.

Questions? Comments? info@institutionalriskanalytics.com




Similar Articles You Might Enjoy:

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.
Tue, 09/22/2009 - 01:41 | Link to Comment Anonymous
Tue, 09/22/2009 - 02:11 | Link to Comment Anonymous
Tue, 09/22/2009 - 09:14 | Link to Comment Anonymous
Tue, 09/22/2009 - 10:55 | Link to Comment Anonymous
Tue, 09/22/2009 - 09:52 | Link to Comment Anonymous
Tue, 09/22/2009 - 09:54 | Link to Comment Anonymous
Tue, 09/22/2009 - 20:25 | Link to Comment DrPsycho
DrPsycho's picture

 

    Your estimate of his IQ is quite generous........3rd rate actor, 4th rate prez......sub par ideas.........

Tue, 09/22/2009 - 02:39 | Link to Comment Anonymous
Tue, 09/22/2009 - 03:09 | Link to Comment Tax Man
Tax Man's picture

Read Dirk Bezemer's excellent paper on how an accounting perspective give better understanding, download from here http://mpra.ub.uni-muenchen.de/15892/

 

Fitch relased a good paper in 2006 or early 2007 about why they didn't give CPDOs a trippel A. They stated that as the maths and models got ever more complex, it was neccessary to aply the common sense test.

Tue, 09/22/2009 - 03:13 | Link to Comment Rusty_Shackleford
Rusty_Shackleford's picture

Can this please be condensed down to "sound bite" length using as many emotionally charged words as possible?  Preferably with some words that rhyme.

Tue, 09/22/2009 - 03:34 | Link to Comment Anonymous
Tue, 09/22/2009 - 03:22 | Link to Comment BabaJ
BabaJ's picture

Academic economics is largely nonsense, and a waste of time due to the fact that most of it has no application in the real world despite claims to the contrary.

Tue, 09/22/2009 - 03:34 | Link to Comment Anonymous
Tue, 09/22/2009 - 07:57 | Link to Comment Daedal
Daedal's picture

Babaj,

 

Agreed. Further, he refers to "common sense" as the primary method for making economic decisions for investors. And yet, he doesn't define that at all. Even more egregious is the fact that "common sense" can be (and is) based on something like Keynesian economics, which, while common sense to many, is just plain wrong -- and as a result, such 'common sense' is directly responsible for misunderstanding and/or causing economic problems (See: Greenspan, Bernanke, Geithner, Bush, Obama, etc...).

Tue, 09/22/2009 - 03:25 | Link to Comment Anonymous
Tue, 09/22/2009 - 03:28 | Link to Comment Anonymous
Tue, 09/22/2009 - 03:36 | Link to Comment kurt_cagle
kurt_cagle's picture

Actually, this is perhaps one of the best description of models, and modelling in general, not just in the economic sphere, that I've read in a long time. Models, by their very definition, require simplification of the non-essential parts of the world relative to the goals of the model, but one of the central challenges that any data modeler faces is in being able to understand what is actually non-essential. I heartily concur with his assessment as well, that too many academic economists fail to learn the rigors of complexity theory, and because of this create models that are simplified to the point of uselessness.

Tue, 09/22/2009 - 03:40 | Link to Comment Anonymous
Tue, 09/22/2009 - 03:40 | Link to Comment Anonymous
Tue, 09/22/2009 - 05:12 | Link to Comment JonML
JonML's picture

An interesting piece but one which confuses political and market economics. Just as the Ronald Reagan quote exposes the statistically ridicolous belief that somehow the existence on almost untrammelled gun ownership is unassociated with high rates of death by shooting, so the author implies that a better understanding of models would somehow reduce bubbles in the economy. The economic bubbles exist because the economy rewards short term profitability. Given the choice of earning relatively small amounts in academia or large amounts producing models which justify VAR or HFT programmes or other mechanisms to create short term gains and personal wealth most invidiuals will opt for wealth.

Tue, 09/22/2009 - 05:53 | Link to Comment Anonymous
Tue, 09/22/2009 - 06:21 | Link to Comment Anonymous
Tue, 09/22/2009 - 07:13 | Link to Comment justrichard
justrichard's picture

Well put.  Why "assume" wealth when you can get some of your own.  Whoremasters.

Tue, 09/22/2009 - 06:30 | Link to Comment Anonymous
Tue, 09/22/2009 - 07:13 | Link to Comment Hephasteus
Hephasteus's picture

Fractional reserve currency is just nonsense. It doesn't model the underlying assets. It makes no sense and adopting a bunch of stupid bad math on top of a fatally flawed underlying system just so a few people can legally counterfeit money has gone on long enough. It "business cycles" because it blows and distorts valuations so much as it runs. It's hyperactive and twitchy at the detriment of long term stability. It's just done. This will be the last great depression because nobody will tolerate it again.

Once a company makes it's IPO's it doesn't give a crap about it's stock or it's investors. It doesn't listen to it's stockholders just like the FED doesn't listen to it's congress. It's always abused always will be abused.

This is just the epitomy of stupidity. Discussing modeling when the very FIRST layer and step of the model is completely broken and the people that know it's broken do everything possible to hide the fact.

Tue, 09/22/2009 - 07:28 | Link to Comment Anonymous
Tue, 09/22/2009 - 07:38 | Link to Comment River Tam
River Tam's picture

Greenspan: "That is the unquenchable capability of human beings when confronted with long periods of prosperity to presume that it will continue."

Tue, 09/22/2009 - 08:09 | Link to Comment Steak
Steak's picture

"Formally studying complex systems requires rigorous training in the cutting edge of mathematics and statistics. It's not for neophytes."

I STRONGLY disagree.  The inventors of the Internet could never have guessed that 5-year olds could be more proficient than most adults.  In that same vein technology is more user friendly and accessible than ever before. 

Understanding the models is easy.  Building the models is hard, but it is not prohibitive.  We are in a period very much like the turn of the century (or even the Renaissance) when amateur scientists were able to devise innovative solutions.

I will never accept an academic or politician telling me something is too complicated. 

Tue, 09/22/2009 - 08:11 | Link to Comment Bruce Krasting
Bruce Krasting's picture

I don't have any models or big computers. I saw this coming and have been writing about for years. If the economists got out into the real world the would have seen it too.

I travel a bit and always have asked about local RE. In 2005 and 2006 that 450 pound man who had heart disease was walking around every part of our country.

In FL people were buying condos with no money down looking to make a buck. 100+ financing was available to anyone with a pen in their hand. Same in Vegas.

Atlanta was just as bad. North of the City they were giving money away to buy RE. Prices are now down 50% and there are still no buyers.

Metro NY/D.C. went on a high end building spree. The sheet rock palaces that are left on the market now have devalued all housing. Still no buyers here either. Take a look at Greenwich, CT.  RE. You can't sell a high end home today.

Cali. was a joke. "smart guys" like Ben Stein were writing that SoCal RE would never go down and that wealth was being created at a biblical pace. Who wouldn't listen to Ben Stein?

Wherever I went RE brokers were just lying. How many units sold etc. were all a pack of lies. A common tread across the country was cheap Agency mortgages coupled with PMI that got the financing up to (or above) 100%. The Agents were selling properties with financing. It was part of the spiel. "I can sell you this one and you will end up with money in your pocket!"  How could one say no.

It was obvious to me that Fannie and Freddie were going to hit a wall with their book of 'enhanced' mortgages. In December of 07 I was on tv and said that they would both go broke in less than one year. (made me persona non grata at Fox).

I am not a smart guy. I just went into the field and kicked some cans, maybe the economist should rely less on the models and more on the real world. They would not have missed it. That sick fat man was very hard to miss.

Tue, 09/22/2009 - 08:18 | Link to Comment TeresaE
TeresaE's picture

Common sense is missing in all aspects of modern life.

I could list hundreds of examples, starting with rewarding welfare recipients to have more children and work fewer hours - while punishing those that try to break away, to the most ecent with people lining up their children for 2 shots of a vaccine that is completely untested in children, offers low protection and has more mercury/squallene than is "safe" for a 250 pound man.  All for a disease that is barely more dangerous than the common flu.

But, I won't.

Suffice it to say that human nature and psychology is the chaos variable that no model will ever be able to accurately predict.  Then add the Law of Unintended Consequences and watch the "accuracy" dissolve.

Academia exists to keep Academia relevant.  Truly doesn't matter what discipline, they sell their "greatness," by producing studies that show them as great.  Common sense has NO place in our modern education system.

 

 

 

 

 

 

 

Tue, 09/22/2009 - 08:28 | Link to Comment Anonymous
Tue, 09/22/2009 - 09:01 | Link to Comment Mediocritas
Mediocritas's picture

Economists haven't got a clue about anything. Their profession pilfered a bunch of equations from 19th century physics and obfuscated the hell out of them into meaningless rubbish with the assistance of bogus mathetmatics and voodoo statistics.

By using tools of science & engineering (math & stats), these goddamn assclowns somehow managed to bamboozle people who should know better into treating them as the equal of legitimate scientists. But economists are NOT scientists, they do not adhere to the scientific method at all, instead belonging in the category of pseudoscience alongside practicioners of astrology, raki, palm-reading, homeopathy and every other piece of superstitious bullshit. Economists are little more than modern day equivalents of the chief priests of old, serving political masters who tout their ideology as a religion / belief system (fractional reserve system).

The fact that there is a Nobel prize for economics is nothing short of a direct insult to legitimate scientists and engineers the world over. These morons have far too much influence in society which is a major contributing factor to us being so deep in the shit.

There is only one aspect of 'economics' that has any credibility at all and that's neuro-economics. Gather a bunch of test subjects and monitor their brain activity using functional NMRI as they make economic decisions. That has a little use, but here's the thing, it's not economics, it's neuroscience with an economic flavour.

Bearded bozos sitting in offices coming up with paper models to explain market behaviour, without any actual on-the-ground experimentation/validation, are just a waste of space and should not be taken seriously for even a second.

Tue, 09/22/2009 - 09:52 | Link to Comment Crab Cake
Crab Cake's picture

The longer that I live the more I become convinced that the agricultural revolution was the worst thing that ever happened to our species.  Economic models have about as much relevance as the cave paintings in southern France.  We live in a fictional reality, and all the while the people that profit from the status quo insist that it is non fiction.  What a farce.  The way we live is an abomination.  If we all treated each other as we would want to be treated we could have heaven on earth, and instead we have.... this.

Tue, 09/22/2009 - 10:44 | Link to Comment Anonymous
Tue, 09/22/2009 - 14:13 | Link to Comment Anonymous
Tue, 09/22/2009 - 16:36 | Link to Comment Anonymous
Do NOT follow this link or you will be banned from the site!