Skip to main content Accessibility help
×
Home

Do natural experiments have an important future in the study of mental disorders?

  • Anita Thapar (a1) and Michael Rutter (a2)

Abstract

There is an enormous interest in identifying the causes of psychiatric disorders but there are considerable challenges in identifying which risks are genuinely causal. Traditionally risk factors have been inferred from observational designs. However, association with psychiatric outcome does not equate to causation. There are a number of threats that clinicians and researchers face in making causal inferences from traditional observational designs because adversities or exposures are not randomly allocated to individuals. Natural experiments provide an alternative strategy to randomized controlled trials as they take advantage of situations whereby links between exposure and other variables are separated by naturally occurring events or situations. In this review, we describe a growing range of different types of natural experiment and highlight that there is a greater confidence about findings where there is a convergence of findings across different designs. For example, exposure to hostile parenting is consistently found to be associated with conduct problems using different natural experiment designs providing support for this being a causal risk factor. Different genetically informative designs have repeatedly found that exposure to negative life events and being bullied are linked to later depression. However, for exposure to prenatal cigarette smoking, while findings from natural experiment designs are consistent with a causal effect on offspring lower birth weight, they do not support the hypothesis that intra-uterine cigarette smoking has a causal effect on attention-deficit/hyperactivity disorder and conduct problems and emerging findings highlight caution about inferring causal effects on bipolar disorder and schizophrenia.

  • View HTML
    • Send article to Kindle

      To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      Do natural experiments have an important future in the study of mental disorders?
      Available formats
      ×

      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

      Do natural experiments have an important future in the study of mental disorders?
      Available formats
      ×

      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

      Do natural experiments have an important future in the study of mental disorders?
      Available formats
      ×

Copyright

This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.

Corresponding author

Author for correspondence: Anita Thapar, E-mail: thapar@cf.ac.uk; thapar@cardiff.ac.uk

References

Hide All
Arnold, BF and Ercumen, A (2016) Negative control outcomes: a tool to detect bias in randomized trials. JAMA 316, 25972598.
Arseneault, L, Milne, BJ, Taylor, A, Adams, F, Delgado, K, Caspi, A and Moffitt, TE (2008) Being bullied as an environmentally mediated contributing factor to children's internalizing problems. Archives of Pediatrics & Adolescent Medicine 162, 145.
C Reactive Protein Coronary Heart Disease Genetics Collaboration (CCGC), Wensley, F, Gao, P, Burgess, S, Kaptoge, S, Di Angelantonio, E, Shah, T, Engert, JC, Clarke, R, Davey-Smith, G, Nordestgaard, BG, Saleheen, D, Samani, NJ, Sandhu, M, Anand, S, Pepys, MB, Smeeth, L, Whittaker, J, Casas, JP, Thompson, SG, Hingorani, AD and Danesh, J (2011) Association between C reactive protein and coronary heart disease: Mendelian randomisation analysis based on individual participant data. BMJ (Clinical Research Ed.) 342, d548.
Caspi, A and Moffitt, TE (1991) Individual differences are accentuated during periods of social change: the sample case of girls at puberty. Journal of Personality and Social Psychology 61, 157168.
Caspi, A, Moffitt, TE, Morgan, J, Rutter, M, Taylor, A, Arseneault, L, Tully, L, Jacobs, C, Kim-Cohen, J and Polo-Tomas, M (2004) Maternal expressed emotion predicts children's antisocial behavior problems: using monozygotic-twin differences to identify environmental effects on behavioral development. Developmental Psychology 40, 149161.
Costello, EJ, Compton, SN, Keeler, G and Angold, A (2003) Relationships between poverty and psychopathology. JAMA 290, 2023.
Costello, EJ, Erkanli, A, Copeland, W and Angold, A (2010) Association of family income supplements in adolescence with development of psychiatric and substance Use disorders in adulthood among an American Indian population. JAMA 303, 1954.
D'Onofrio, BM, Turkheimer, EN, Eaves, LJ, Corey, LA, Berg, K, Solaas, MH and Emery, RE (2003) The role of the children of twins design in elucidating causal relations between parent characteristics and child outcomes. Journal of Child Psychology and Psychiatry, and Allied Disciplines 44, 11301144.
Davey Smith, G and Hemani, G (2014) Mendelian randomization: genetic anchors for causal inference in epidemiological studies. Human Molecular Genetics 23, R89R98.
Eidelman, RS, Hollar, D, Hebert, PR, Lamas, GA and Hennekens, CH (2004) Randomized trials of vitamin E in the treatment and prevention of cardiovascular disease. Archives of Internal Medicine 164, 1552.
Eley, TC, McAdams, TA, Rijsdijk, FV, Lichtenstein, P, Narusyte, J, Reiss, D, Spotts, EL, Ganiban, JM and Neiderhiser, JM (2015) The intergenerational transmission of anxiety: a children-of-twins study. American Journal of Psychiatry 172, 630637.
Giordano, GN, Ohlsson, H, Sundquist, K, Sundquist, J and Kendler, KS (2015) The association between cannabis abuse and subsequent schizophrenia: a Swedish national co-relative control study. Psychological Medicine 45, 407414.
Ge, X, Conger, RD, Cadoret, RJ, Neiderhiser, JM, Yates, W, Troughton, E and Stewart, M (1996) The developmental interface between nature and nurture: a mutual influence model of child antisocial behavior and parent behaviors. Developmental Psychology 32, 574589.
Harold, GT, Rice, F, Hay, DF, Boivin, J, van den Bree, M and Thapar, A (2011) Familial transmission of depression and antisocial behavior symptoms: disentangling the contribution of inherited and environmental factors and testing the mediating role of parenting. Psychological Medicine 41, 11751185.
Hawton, K, Bergen, H, Simkin, S, Dodd, S, Pocock, P, Bernal, W, Gunnell, D and Kapur, N (2013) Long term effect of reduced pack sizes of paracetamol on poisoning deaths and liver transplant activity in England and wales: interrupted time series analyses. BMJ (Clinical Research Ed.) 346, f403.
Howe, LD, Tilling, K, Matijasevich, A, Petherick, ES, Santos, AC, Fairley, L, Wright, J, Santos, IS, Barros, AJD, Martin, RM, Kramer, MS, Bogdanovich, N, Matush, L, Barros, H and Lawlor, DA (2016) Linear spline multilevel models for summarising childhood growth trajectories: a guide to their application using examples from five birth cohorts. Statistical Methods in Medical Research 25, 18541874.
Jaffee, SR, Caspi, A, Moffitt, TE, Polo-Tomas, M, Price, TS and Taylor, A (2004) The limits of child effects: evidence for genetically mediated child effects on corporal punishment but not on physical maltreatment. Developmental Psychology 40, 10471058.
Kendler, KS, Karkowski, LM and Prescott, CA (1999) Causal relationship between stressful life events and the onset of major depression. American Journal of Psychiatry 156, 837841.
Kendler, KS, Ohlsson, H, Sundquist, K and Sundquist, J (2018) Sources of parent-offspring resemblance for major depression in a National Swedish extended adoption study. JAMA Psychiatry 75, 194.
Kraemer, HC, Kazdin, AE, Offord, DR, Kessler, RC, Jensen, PS and Kupfer, DJ (1997) Coming to terms with the terms of risk. Archives of General Psychiatry 54, 337343.
Krieger, N and Davey Smith, G (2016) The tale wagged by the DAG: broadening the scope of causal inference and explanation for epidemiology. International Journal of Epidemiology 45, dyw114.
Langley, K, Heron, J, Smith, GD and Thapar, A (2012) Maternal and paternal smoking during pregnancy and risk of ADHD symptoms in offspring: testing for intrauterine effects. American Journal of Epidemiology 176, 261268.
Lynch, SK, Turkheimer, E, D'Onofrio, BM, Mendle, J, Emery, RE, Slutske, WS and Martin, NG (2006) A genetically informed study of the association between harsh punishment and offspring behavioral problems. Journal of Family Psychology 20, 190198.
McAdams, TA, Rijsdijk, FV, Neiderhiser, JM, Narusyte, J, Shaw, DS, Natsuaki, MN, Spotts, EL, Ganiban, JM, Reiss, D, Leve, LD, Lichtenstein, P and Eley, TC (2015) The relationship between parental depressive symptoms and offspring psychopathology: evidence from a children-of-twins study and an adoption study. Psychological Medicine 45, 25832594.
McGuffin, P, Katz, R and Bebbington, P (1988) The Camberwell collaborative depression study. III. Depression and adversity in the relatives of depressed probands. The British Journal of Psychiatry 152, 775782.
Nagel, M, Jansen, PR, Stringer, S, Watanabe, K, de Leeuw, CA, Bryois, J, Savage, JE, Hammerschlag, AR, Skene, NG, Muñoz-Manchado, AB, White, T, Tiemeier, H, Linnarsson, S, Hjerling-Leffler, J, Polderman, TJC, Sullivan, PF, van der Sluis, S and Posthuma, D (2018) Meta-analysis of genome-wide association studies for neuroticism in 449484 individuals identifies novel genetic loci and pathways. Nature Genetics 50, 920927.
Nilsson, P (2008) Does a pint a day affect your child's pay. The effect of prenatal alcohol exposure on adult outcomes. CeMMAP Working Paper vol CWP22/08 no. CWP22/08 CeMMAP working papers.
Pingault, J-B, O'Reilly, PF, Schoeler, T, Ploubidis, GB, Rijsdijk, F and Dudbridge, F (2018) Using genetic data to strengthen causal inference in observational research. Nature Reviews Genetics 19, 566580.
Plomin, R (2018) Blueprint: How DNA Makes Us Who We Are. London: Allen Lane.
Power, RA, Tansey, KE, Buttenschøn, HN, Cohen-Woods, S, Bigdeli, T, Hall, LS, Kutalik, Z, Lee, SH, Ripke, S, Steinberg, S, Teumer, A, Viktorin, A, Wray, NR, Arolt, V, Baune, BT, Boomsma, DI, Børglum, AD, Byrne, EM, Castelao, E, Craddock, N, Craig, IW, Dannlowski, U, Deary, IJ, Degenhardt, F, Forstner, AJ, Gordon, SD, Grabe, HJ, Grove, J, Hamilton, SP, Hayward, C, Heath, AC, Hocking, LJ, Homuth, G, Hottenga, JJ, Kloiber, S, Krogh, J, Landén, M, Lang, M, Levinson, DF, Lichtenstein, P, Lucae, S, MacIntyre, DJ, Madden, P, Magnusson, PKE, Martin, NG, McIntosh, AM, Middeldorp, CM, Milaneschi, Y, Montgomery, GW, Mors, O, Müller-Myhsok, B, Nyholt, DR, Oskarsson, H, Owen, MJ, Padmanabhan, S, Penninx, BWJH, Pergadia, ML, Porteous, DJ, Potash, JB, Preisig, M, Rivera, M, Shi, J, Shyn, SI, Sigurdsson, E, Smit, JH, Smith, BH, Stefansson, H, Stefansson, K, Strohmaier, J, Sullivan, PF, Thomson, P, Thorgeirsson, TE, Van der Auwera, S, Weissman, MM, Breen, G, Lewis, CM and Lewis, CM (2017) Genome-wide association for major depression through age at onset stratification: major depressive disorder working group of the psychiatric genomics consortium. Biological Psychiatry 81, 325335.
Pulkkinen, L, Kaprio, J, Rose, R (eds) (2006) Socioemotional Development and Health From Adolescence to Adulthood. New York, US: Cambridge University Press.
Quinn, PD, Rickert, ME, Weibull, CE, Johansson, ALV, Lichtenstein, P, Almqvist, C, Larsson, H, Iliadou, AN and D'Onofrio, BM (2017) Association between maternal smoking during pregnancy and severe mental illness in offspring. JAMA Psychiatry 74, 589.
Rice, F, Harold, GT and Thapar, A (2003) Negative life events as an account of age-related differences in the genetic aetiology of depression in childhood and adolescence. Journal of Child Psychology and Psychiatry, and Allied Disciplines 44, 977987.
Rice, F, Harold, GT, Boivin, J, Hay, DF, van den Bree, M and Thapar, A (2009) Disentangling prenatal and inherited influences in humans with an experimental design. Proceedings of the National Academy of Sciences of the USA 106, 24642467.
Rice, F, Harold, GT, Boivin, J, van den Bree, M, Hay, DF and Thapar, A (2010) The links between prenatal stress and offspring development and psychopathology: disentangling environmental and inherited influences. Psychological Medicine 40, 335.
Rice, F, Langley, K, Woodford, C, Davey Smith, G and Thapar, A (2018) Identifying the contribution of prenatal risk factors to offspring development and psychopathology: what designs to use and a critique of literature on maternal smoking and stress in pregnancy. Development and Psychopathology 30, 11071128.
Riglin, L, Collishaw, S, Richards, A, Thapar, AK, Rice, F, Maughan, B, O'Donovan, MC and Thapar, A (2017) The impact of schizophrenia and mood disorder risk alleles on emotional problems: investigating change from childhood to middle age. Psychological Medicine 48, 16.
Rutter, M (2007) Proceeding from observed correlation to causal inference: the use of natural experiments. Perspectives on Psychological Science 2, 377395.
Rutter, M and Thapar, A (2016) Developmental Psychopathology, 3rd Edn. Cicchetti, D. New Jersey, USA: Wiley.
Sedgwick, P (2013) Statistical question: selection bias versus allocation bias. BMJ (Online) 346, f3345.
Silberg, JL, Maes, H and Eaves, LJ (2010) Genetic and environmental influences on the transmission of parental depression to children's depression and conduct disturbance: an extended children of twins study. Journal of Child Psychology and Psychiatry 51, 734744.
Silberg, JL, Copeland, W, Linker, J, Moore, AA, Roberson-Nay, R and York, TP (2016) Psychiatric outcomes of bullying victimization: a study of discordant monozygotic twins. Psychological Medicine 46, 18751883.
Singh, AL, D'Onofrio, BM, Slutske, WS, Turkheimer, E, Emery, RE, Harden, KP, Heath, AC, Madden, PAF, Statham, DJ and Martin, NG (2011) Parental depression and offspring psychopathology: a children of twins study. Psychological Medicine 41, 13851395.
Sonuga-Barke, EJS, Kennedy, M, Kumsta, R, Knights, N, Golm, D, Rutter, M, Maughan, B, Schlotz, W and Kreppner, J (2017) Child-to-adult neurodevelopmental and mental health trajectories after early life deprivation: the young adult follow-up of the longitudinal English and Romanian adoptees study. The Lancet 389, 15391548.
St Clair, D, Xu, M, Wang, P, Yu, Y, Fang, Y, Zhang, F, Zheng, X, Gu, N, Feng, G, Sham, P and He, L (2005) Rates of adult schizophrenia following prenatal exposure to the Chinese famine of 1959–1961. JAMA 294, 557.
State, MW and Thapar, A (2015) Genetics. In Thapar, A, Pine, DS, Leckman, JF, Scott, S, Snowling, MJ & Taylor, E (eds), Rutter's Child and Adolescent Psychiatry, 6th Edn. Oxford: John Wiley & Sons Limited, pp. 303316.
Stattin, H and Magnusson, D (1990) Pubertal Maturation in Female Development. Paths Through Life, vol. 2. Hillsdale, NJ: Psychology Press.
Sullivan, PF, Neale, MC and Kendler, KS (2000) Genetic epidemiology of major depression: review and meta-analysis. American Journal of Psychiatry 157, 15521562.
Susser, E, Neugebauer, R, Hoek, HW, Brown, AS, Lin, S, Labovitz, D and Gorman, JM (1996) Schizophrenia after prenatal famine. Further evidence. Archives of General Psychiatry 53, 2531.
Thapar, A and Rutter, M (2009) Do prenatal risk factors cause psychiatric disorder? Be wary of causal claims. British Journal of Psychiatry 195, 100101.
Thapar, A and Rutter, M (2015) Using natural experiments and animal models to study causal hypotheses in relation to child mental health problems. In Thapar, A, Pine, DS, Leckman, JF, Scott, S, Snowling, M & Tay, E (eds), Rutter's Child and Adolescent Psychiatry, 6th Edn. Oxford, John Wiley and Sons Limited, pp. 145162.
Thapar, A, Harold, G, Rice, F, Ge, X, Boivin, J, Hay, D, van den Bree, M and Lewis, A (2007) Do intrauterine or genetic influences explain the foetal origins of chronic disease? A novel experimental method for disentangling effects. BMC Medical Research Methodology 7, 25.
Thapar, A, Rice, F, Hay, D, Boivin, J, Langley, K, van den Bree, M, Rutter, M and Harold, G (2009) Prenatal smoking might not cause attention-deficit/hyperactivity disorder: evidence from a novel design. Biological Psychiatry 66, 722727.
Thornberry, TP, Krohn, MD, Lizotte, AJ and Chard-Wierschem, D (1993) The role of juvenile gangs in facilitating delinquent behavior. Journal of Research in Crime and Delinquency 30, 5587.
Thornberry, TP, Krohn, MD, Lizotte, AJ, Smith, CA and Tobin, K (2002) Gangs and Delinquency in Developmental Perspective. Cambridge: Cambridge University Press.

Keywords

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed