Skip to main content Accessibility help
×
Hostname: page-component-84b7d79bbc-5lx2p Total loading time: 0 Render date: 2024-07-27T20:26:03.089Z Has data issue: false hasContentIssue false

9 - The design of experiments

Published online by Cambridge University Press:  15 December 2009

David J. Lilja
Affiliation:
University of Minnesota
Get access

Summary

‘The fundamental principle of science, the definition almost, is this: the sole test of the validity of any idea is experiment.’

Richard P. Feynman

The primary goal of the design of experiments is to determine the maximum amount of information about a system with the minimum amount of effort. A well-designed experiment guides the experimenter in choosing what experiments actually need to be performed. From the resulting measurements, the experimenter can determine the effects on performance of each individual input factor, and the effects of their interactions. The form of the experimental design also allows a quantitative evaluation of the error inherent in the experimental measurements relative to the overall system response.

A key assumption behind the design of experiments is that there is a nonzero cost associated with performing an experiment. This cost includes the time and effort required to gather the necessary data, plus the time and effort needed to analyze these data to draw some appropriate conclusions. Consequently, it is important to minimize the number of experiments that must be performed while maximizing the information obtained.

Good experiment design allows the experimenter to

  • isolate the effects of each individual input variable,

  • determine the effects due to interactions of the input variables,

  • determine the magnitude of the change in the system's output due to the experimental error, and

  • obtain the maximum amount of information with the minimum amount of effort by limiting and controlling the number of experiments that must be performed.

Types of experiments

The simplest design for an experiment varies one input (factor) while holding all of the other inputs constant.

Type
Chapter
Information
Measuring Computer Performance
A Practitioner's Guide
, pp. 157 - 180
Publisher: Cambridge University Press
Print publication year: 2000

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

  • The design of experiments
  • David J. Lilja, University of Minnesota
  • Book: Measuring Computer Performance
  • Online publication: 15 December 2009
  • Chapter DOI: https://doi.org/10.1017/CBO9780511612398.010
Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

  • The design of experiments
  • David J. Lilja, University of Minnesota
  • Book: Measuring Computer Performance
  • Online publication: 15 December 2009
  • Chapter DOI: https://doi.org/10.1017/CBO9780511612398.010
Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

  • The design of experiments
  • David J. Lilja, University of Minnesota
  • Book: Measuring Computer Performance
  • Online publication: 15 December 2009
  • Chapter DOI: https://doi.org/10.1017/CBO9780511612398.010
Available formats
×