Skip to main content Accessibility help
  • Print publication year: 2020
  • Online publication date: March 2020

21 - Sample Ratio Mismatch and Other Trust-Related Guardrail Metrics

from Part V - Advanced Topics for Analyzing Experiments


Why you care: Guardrail metrics are critical metrics designed to alert experimenters about violated assumptions. There are two types of guardrail metrics: organizational and trust-related. Chapter 7 discusses organizational guardrails that are used to protect the business, and this chapter describes the Sample Ratio Mismatch (SRM) in detail, which is a trust-related guardrail. The SRM guardrail should be included for every experiment, as it is used to ensure the internal validity and trustworthiness of the experiment results. A few other trust-related guardrail metrics are also described here.

Related content

Powered by UNSILO