Simulation-based acquisition: too many studies.

• Author: O'Bryon, James F.
• Position: Department of Defense

Modeling and simulation have long been touted by the Defense Department as offering savings in time and money in developing military systems. But efforts to move toward "simulation based acquisition" in the military remain only a bumper sticker.

Estimates for how much is spent annually on modeling and simulation in the Defense Department range from $5 billion to $30 billion, depending on how one defines modeling and simulation. While some of the spending is in support of training, the bulk of the funds are allocated to research, development, testing and evaluation of new defense acquisition programs.

A recent report published by the National Research Council committee on modeling and simulation enhancements for 21st century manufacturing and acquisition provides some thought-provoking observations regarding the history and progress, or lack thereof. It was commissioned by the undersecretary of defense for acquisition, technology and logistics.

The committee reviewed no less than 10 other studies which had earlier addressed many of the same concerns regarding the lack of organization and structure in the Defense Department's modeling and simulation activities.

Einstein defined insanity as "doing the same thing over and over, expecting different results." This is essentially what has been happening during the past two decades in modeling and simulation. Numerous studies conducted over this time period are unanimous in their conclusions.

However, findings don't remedy problems. Recommendations must be acted upon. In fact, Johnny Foster, the former Defense Science Board chairman, noted that the "best way to make recommendations become of no effect is to simply agree with them."

Regardless of whether the annual Defense Department investment in modeling and simulation is $5 billion or $30 billion, it's a huge investment that must not be squandered.

According to the National Research Council report, "Many barriers remain to more widespread use of modeling and simulation in defense systems acquisition. These barriers include inadequate allocation of resources, lack of information for acquisition program managers, lack...