The way to succeed is to double your failure rate. That comment by Thomas Watson, Sr. is not among the innovators' words of wisdom in Stefan Thomke's densely informative exploration of technologies and processes of experimentation but it perfectly fits the message. Central to Thomke's message in this book is the idea that iterated experimentation through the use of models, prototypes, and computer simulations is the key to learning and innovation. Getting the key to fit in the lock of increased organizational innovation capability, however, takes some jiggling and struggling. Experimentation Matters details the technologies that can transform innovation but place just as much emphasis on the changes that must be made to business processes, organization, culture, incentives, and management. Thomke provides plenty of detailed illustrations of companies wrestling with these issues, and offers six principles revolving to help companies experiment early and often and to organize for rapid iteration.
The first part of the book explains in depth the reasons why experimentation matters for learning and innovation, and how new technologies are affecting the development of both products and services. Thomke shows how the rate of learning is influenced by several factors that affect the process and how it is managed: fidelity, cost, iteration time, capacity, sequential and parallel strategies, signal-to-noise ratio, and type of experiment. Beneath the bewildering diversity of approaches to innovation in different industries, Thomke uncovers six principles that can improve how experimentation occurs: Anticipate and exploit early information through front-loaded innovation processes; Experiment frequently but do not overload your organization; Integrate new and traditional technologies to unlock performance; Organize for rapid experimentation; Fail early and often but avoid "mistakes"; and Manage projects as experiments.
In the final chapter, Thomke looks at how some companies are "shifting the locus of experimentation" to customers as a way to create new value. This approach, sometimes referred to as "co-creation", not only raises productivity but helps fundamentally change the sorts of products and services that can be created. Innovation toolkits given to customers need to enable them to iterate through the steps of experimentation, be user-friendly, contain libraries of useful, pretested and debugged components and modules, and they must contain information abut the capabilities and limitations of the production process. In addition to the development of a customer toolkit, Thomke adds four other steps for shifting experimentation and innovation to customers and, very importantly, notes how the creation and capture of value also shifts.
One great strength of Thomke's book is the attention given to the managerial and organizational challenges of implementing new technologies such as computer modeling and simulation and combinatorial and high-throughput testing. As other writers have repeatedly emphasized - but many managers have not yet understood - new technologies *must* be introduced only in concert with revised business processes, structures, and management approaches. Iterated experimentation helps learning by increasing the number of failures. But if incentives continue to punish failures, the new technologies will be underused or misused. Financial incentives, organizational culture, and management communications will have to change if experimenters are to feel free to fail at the most productive rate.
Thomke illustrates and details the crucial role of organization, process, and management in realizing the potential of experimentation technologies with a range of illuminating cases. He devotes a chapter to these effects in the integrated circuit industry, examines the challenges faced by Bank of America in its bold service experimentation efforts, and shows how managers at Eli Lilly struggled with non-technological aspects of high-powered experimentation in the drug discovery process. A study of experimentation in the auto industry, particularly at BMW, suggests several lessons regarding the reality of technology introduction: Technologies are limited by the processes and people that use them; organizational interfaces can get in the way of experimentation; and technologies change faster than behavior. Thomke also shows how managers can look at projects as experiments, reiterating, refining, and learning from them as they proceed through the stages of design, build, run, and analyze.