Transforming Research and Development with Design of Experiments
10.09.2020 - Gaining and maintaining competitive advantage requires today’s organizations to innovate at increasing speed.
As products and processes become more complex, subject matter expertise alone does not always deliver progress at the pace demanded. “Trial-and-error” methods do not always yield optimal solutions when time is limited. A more systematic approach is required.
Many experts working in R&D rely on a traditional approach to this problem, changing one variable at a time. It might seem to offer the structure for more predictability, but such an approach can end up constraining innovation and decreasing efficiency in the long run. One-factor-at-a-time methods have some shortcomings, as they overlook synergistic and antagonistic interactions. They do not use proper randomization, and lurking variables might spoil results and lead to false conclusions.
The answer for an increasing number of organizations is design of experiments (DOE). DOE enables scientists to look at interactions, utilize randomization and change multiple factors — all leading to a better understanding of processes with fewer experiments. Proponents of DOE claim significant advantages, so why aren’t more scientists seizing the opportunity to optimize processes while saving time and money through adoption of designed experiments?
Overcoming Objections to DOE
Pilar Gomez Jimenez, Principal Scientist at Johnson Matthey, has a master’s degree and a PhD in chemical engineering. She has been working in R&D of catalysts and materials for over 15 years and is an enthusiastic practitioner of DOE.
“At Johnson Matthey, DOE has delivered 50 to 70 percent savings in time and resources.”
Pilar Gomez Jimenez, Principal Scientist, Johnson Matthey
At Johnson Matthey, DOE has delivered 50% to 70% savings in time and resources. She says that gaining management support has not been a problem. According to Gomez Jimenez, the main obstacle when encouraging others to adopt DOE is always the human factor: “As humans, we struggle to visualize a multivariate experimental space. We are able to imagine the effect of changing temperature, but if we are moving temperature and pressure at the same time, then analyzing the data gets more complicated and our minds struggle to visualize it.”
Perhaps because many scientists are taught to work with one factor at a time or because they have been doing things a certain way for a long time, it can be difficult to persuade teams to overcome their initial fear of statistical approaches to experimentation. Gomez Jimenez says it is essential to support colleagues to explore something new, particularly where a statistical approach is required.
Widespread adoption of DOE can often be hampered by initial fears that the process will be onerous, or that the scale and type of problem is not suited to DOE. In fact, DOE is a methodology that scales regardless of the size of the problem. It provides the ability to thoroughly explore the opportunity space, enabling scientists to define an efficient and effective data collection plan that enables them to build a model of the product or process. That model can then increase understanding of the problem, drive decisions and enable consensus with other stakeholders. The more complex a problem and the more factors involved, the bigger the opportunity space to be explored — and the greater the impact of DOE.
Achieving Life-Changing Results
Tim Gardner is a scientist and the CEO and founder of Riffyn, an organization enabling scientists to easily combine DOE with efficient data management and contextualization. Gardner said recently that DOE has changed his life, just as it has changed organizations where he worked in the past. Some plants where he worked with DOE experienced a productivity boost of 10-15%. Time to market for new products reduced fourfold, sometimes more, in one case shrinking from 15 months to 3 months.
Results like this inspired Gardner to found Riffyn and seek to make DOE a standard way of operating for more organizations. But he recognizes that people fear change, and for many, DOE represents the unknown. Whether there is confusion over the term DOE and what it actually means, or uncertainty over the use of maths and statistics, fear can prevent many organizations from seizing the opportunity. Seeing the transformational results of DOE first-hand is often an excellent motivator for organizations to embrace a new approach.
DOE helps scientists design and analyze results rapidly and in a visual way, enabling them to understand analyses quickly and explain them to other people. Visualization is key to demonstrating the value of the process to the wider organization without needing an in-depth knowledge of statistical analysis. Whether supporting the delivery of better solutions, products or services, a statistically designed approach to experiments can accelerate the discovery and creation of viable new solutions and ensure that they can be delivered at pace and at scale.
DOE offers plenty of advantages beyond saving time and resources. Improved predictability helps with planning and enables more efficient ways of working. This efficiency can help to ease the pressure levels within teams under pressure to deliver. Organizations can make better decisions faster and meet project milestones more predictably. Reducing the stress on individuals by giving them the right tools to be productive and efficient can benefit the whole organization.
Creating the Time and Space for Innovation
By actively manipulating factors according to a pre-specified plan, it is possible to gain a new understanding of relationships between inputs and outputs; achieve faster, more predictable cycles; and save time: in short, to know when a concept will work and when it will not.
Gomez Jimenez explains that because “you‘re looking at the full experimental space and getting a proper map of what the results will be and the interactions between the variables, the result is greater insight and confidence in the conclusions.”
With the right tools, it is easy to get started and experience some quick wins, which in turn helps to convince colleagues, teams and the wider organization that there are significant benefits to be achieved with DOE. Bradley Jones, Senior Research Fellow at JMP, calls DOE “active learning” and highlights how it gives organizations the ability to “fail fast”, which in turn drives rapid innovation. Perhaps reframing DOE in these terms would help to demystify it and encourage more scientists and organizations to make the leap.
Author: Peter Goos, Professor at the Faculty of Bio-Science Engineering, University of Leuven, Leuven, Belgium