Skip to main content Accessibility help
Hostname: page-component-544b6db54f-dkqnh Total loading time: 0.292 Render date: 2021-10-23T23:10:28.760Z Has data issue: true Feature Flags: { "shouldUseShareProductTool": true, "shouldUseHypothesis": true, "isUnsiloEnabled": true, "metricsAbstractViews": false, "figures": true, "newCiteModal": false, "newCitedByModal": true, "newEcommerce": true, "newUsageEvents": true }

What changes when? A reply to Beauchaine and Slep

Published online by Cambridge University Press:  04 September 2018

Joyce Weeland*
University of Amsterdam Utrecht University
Rabia R. Chhangur
University of Amsterdam Utrecht University
Sara R. Jaffee
University of Pennsylvania
Danielle van der Giessen
University of Amsterdam
Walter Matthys
Utrecht University
Bram Orobio de Castro
Utrecht University
Geertjan Overbeek
University of Amsterdam
Address correspondence and reprint requests to: Joyce Weeland, Research Institute of Child Development and Education, University of Amsterdam, Nieuwe Achtergracht 127 Amsterdam; E-mail:


In their commentary, Beauchaine and Slep (2018) raise important issues regarding research on behavioral parenting training (BPT). In this reply we highlight key points of agreement and respond to issues that we feel require clarification. BPT has been repeatedly proven effective in decreasing disruptive child behavior (also in the work of our research team). Yet, there is much to learn about for whom and how BPT is effective. Specifically, assessing the how (i.e., mediation) comes with many challenges. One of these challenges is taking into account the timeline of change, and being able to infer causal mechanisms of change. We argue that cross-lagged panel models (which we, and many other scholars, used) are a valid and valuable method for testing mediation. At the same time, our results raise important questions, specifically about the timing and form of expected changes in parenting and child behavior after BPT. For example, are these changes linear and gradual or do they happen more suddenly? To select the appropriate design, assessment tools, and statistical models to test mediation, we need to state detailed hypotheses on what changes when. An important next step might be to assess multiple putative mediators on different timescales, not only before and after, but specifically also during BPT.

Copyright © Cambridge University Press 2018 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)


This work was financially supported by the Netherlands Organization for Scientific Research (NWO: 452-10-005).


Aderka, I. M., Nickerson, A., Bøe, H. J., & Hofmann, S. G. (2012). Sudden gains during psychological treatments of anxiety and depression: A meta-analysis. Journal of Consulting and Clinical Psychology, 80, 93101. doi:10.1037/a0026455CrossRefGoogle ScholarPubMed
Aliev, F., Latendresse, S. J., Bacanu, S.-A., Neale, M. C., & Dick, D. M. (2014). Testing for measured gene–environment interaction: Problems with the use of cross-product terms and a regression model reparameterization solution. Behavior Genetics, 44, 165181. doi:10.1007/s10519-014-9642-1CrossRefGoogle Scholar
Aunola, K., Viljaranta, J., & Tolvanen, A. (2017). Does daily distress make parents prone to using psychologically controlling parenting? International Journal of Behavioral Development, 41, 405414. doi:10.1177/0165025416658555CrossRefGoogle Scholar
Bamberger, K. T. (2016). The application of intensive longitudinal methods to investigate change: Stimulating the field of applied family research. Clinical Child and Family Psychology Review, 19, 2138. doi:10.1007/s10567-015-0194-6CrossRefGoogle ScholarPubMed
Baron, R. M., & Kenny, D. A. (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51, 11731182. doi:10.1037//0022-3514.51.6.1173CrossRefGoogle ScholarPubMed
Beauchaine, T. P., & Slep, A. (2018). Mechanisms of child behavior change in parent training: Comment on Weeland et al. (2018). Development and Psychopathology. doi:10.1017/S0954579418000810Google Scholar
Bell, Z., Shader, T. M., Webster-Stratton, C., Reid, M. J., & Beauchaine, T. P. (2018). Improvements in negative parenting mediate changes in children's autonomic responding following a preschool intervention for ADHD. Clinical Psychological Science, 6, 134144.CrossRefGoogle ScholarPubMed
Berry, D., & Willoughby, M. T. (2017). On the practical interpretability of cross-lagged panel models: Rethinking a developmental workhorse. Child Development, 88, 11861206. doi:10.1111/cdev.12660CrossRefGoogle ScholarPubMed
Bolger, N., & Laurenceau, J.-P. (2013). Intensive longitudinal methods: An introduction to diary and experience sampling research (1st ed.). New York: Guilford Press.Google Scholar
Burke, J. D., & Loeber, R. (2016). Mechanisms of behavioral and affective treatment outcomes in a cognitive behavioral intervention for boys. Journal of Abnormal Child Psychology, 44, 179189. doi:10.1007/s10802-015-9975-0CrossRefGoogle Scholar
Chhangur, R. R., Weeland, J., Overbeek, G., Matthys, W., & Orobio de Castro, B. (2012). ORCHIDS: An observational randomized controlled trial on childhood differential susceptibility. BMC Public Health, 12, 917. doi:10.1186/1471-2458-12-917CrossRefGoogle ScholarPubMed
Chhangur, R. R., Weeland, J., Overbeek, G., Matthys, W., Orobio de Castro, B., van der Giessen, D., & Belsky, J. (2017). Genetic moderation of intervention efficacy: Dopaminergic genes, the Incredible Years, and externalizing behavior in children. Child Development, 88, 796811. doi:10.1111/cdev.12612CrossRefGoogle ScholarPubMed
Cohen, L. L., Feinstein, A., Masuda, A., & Vowles, K. E. (2014). Single-case research design in pediatric psychology: Considerations regarding data analysis. Journal of Pediatric Psychology, 39, 124137. doi:10.1093/jpepsy/jst065CrossRefGoogle ScholarPubMed
Cole, D. A., & Maxwell, S. E. (2003). Testing mediational models with longitudinal data: Questions and tips in the use of structural equation modeling. Journal of Abnormal Psychology, 112, 558577. doi:10.1037/0021-843X.112.4.558CrossRefGoogle ScholarPubMed
Dick, D. M., Agrawwal, A., Keller, M. C., Adkins, A., Aliev, F., Monroe, S., … Sher, K. J. (2015). Candidate gene-environment interaction research: Reflections and recommendations. Perspectives on Psychological Science, 10, 3759. doi:10.1177.1745691614556682CrossRefGoogle ScholarPubMed
Falk, A., & Compton, S. N. (2016). Using sequential, multiple assignment, randomized trial (SMART) methodology to tailor evidence-based treatments. Journal of the American Academy of Child & Adolescent Psychiatry, 55, S262. doi:10.1016/j.jaac.2016.07.137CrossRefGoogle Scholar
Feldman, M. A., & Werner, S. E. (2002). Collateral effects of behavioral parent training on families of children with developmental disabilities and behavior disorders. Behavioral Interventions, 17, 7583. doi:10.1002/bin.111CrossRefGoogle Scholar
Fritz, M. S., & MacKinnon, D. P. (2007). Required sample size to detect the mediated effect. Psychological Science, 18, 233239. doi:10.1111/j.1467-9280.2007.01882.xCrossRefGoogle ScholarPubMed
Geukes, K., Nestler, S., Hutteman, R., Küfner, A. C. P., & Back, M. D. (2017). Trait personality and state variability: Predicting individual differences in within- and cross-context fluctuations in affect, self-evaluations, and behavior in everyday life. Journal of Research in Personality, 69, 124138. doi:10.1016/j.jrp.2016.06.003CrossRefGoogle Scholar
Hamaker, E. L., Kuiper, R. M., & Grasman, R. P. (2015). A critique of the cross-lagged panel model. Psychological Methods, 21, 102116. doi: 10.1037/a0038889CrossRefGoogle Scholar
Hesser, H., Hedman-Lagerlöf, E., Andersson, E., Lindfors, P., & Ljótsson, B. (2018). How does exposure therapy work? A comparison between generic and gastrointestinal anxiety–specific mediators in a dismantling study of exposure therapy for irritable bowel syndrome. Journal of Consulting and Clinical Psychology, 86, 254267. doi:10.1037/ccp0000273CrossRefGoogle Scholar
Kazdin, A. E. (2007). Mediators and mechanisms of change in psychotherapy research. Annual Review of Clinical Psychology, 3, 127. doi:10.1146/annurev.clinpsy.3.022806.091432CrossRefGoogle ScholarPubMed
Kazdin, A. E., & Nock, M. K. (2003). Delineating mechanisms of change in child and adolescent therapy: Methodological issues and research recommendations. Journal of Child Psychology and Psychiatry, 44, 11161129. doi:10.1111/1469-7610.00195CrossRefGoogle ScholarPubMed
Lebowitz, M. S. (2016). Stigmatization of ADHD. Journal of Attention Disorders, 20, 199205. doi:10.1177/1087054712475211CrossRefGoogle ScholarPubMed
Leijten, P., Dishion, T. J., Thomaes, S., Raaijmakers, M. A., Orobio de Castro, B., & Matthys, W. (2015). Bringing parenting interventions back to the future: How randomized microtrials may benefit parenting intervention efficacy. Clinical Psychology: Science and Practice, 22, 4757. doi:10.1111/cpsp.12087Google Scholar
Leijten, P., Raaijmakers, M. A. J., Orobio de Castro, B., Van den Ban, E., & Matthys, W. (2017). Effectiveness of the Incredible Years parenting program for families with socioeconomically disadvantaged and ethnic minority backgrounds. Journal of Clinical Child & Adolescent Psychology, 46, 5973. doi:10.1080/15374416.2015.1038823CrossRefGoogle ScholarPubMed
Lemmens, L. H. J. M., Müller, V. N. L. S., Arntz, A., & Huibers, M. J. H. (2016). Mechanisms of change in psychotherapy for depression: An empirical update and evaluation of research aimed at identifying psychological mediators. Clinical Psychology Review, 50, 95107. doi:10.1016/j.cpr.2016.09.004CrossRefGoogle ScholarPubMed
Longwell, B. T., & Truax, P. (2005). The differential effects of weekly, monthly, and bimonthly administrations of the beck Depression Inventory-II: Psychometric properties and clinical implications. Behavior Therapy, 36, 265275. doi:10.1016/S0005-7894(05)80075-9CrossRefGoogle Scholar
Manson, J. H., & Robbins, M. L. (2017). New evaluation of the electronically activated recorder (EAR): Obtrusiveness, compliance, and participant self-selection effects. Frontiers in Psychology, 8, 658. doi:10.3389/fpsyg.2017.00658CrossRefGoogle ScholarPubMed
Mathis, E. T. B., & Bierman, K. L. (2015). Effects of parent and child pre-intervention characteristics on child skill acquisition during a school readiness intervention. Early Childhood Research Quarterly, 33, 8797. doi:10.1016/J.ECRESQ.2015.07.002CrossRefGoogle ScholarPubMed
Mehl, M. R. (2017). The electronically activated recorder (EAR). Current Directions in Psychological Science, 26, 184190. doi:10.1177/0963721416680611CrossRefGoogle Scholar
Menting, A. T. A., Orobio de Castro, B., & Matthys, W. (2013). Effectiveness of the Incredible Years parent training to modify disruptive and prosocial child behavior: A meta-analytic review. Clinical Psychology Review, 33, 901913. doi:10.1016/j.cpr.2013.07.006CrossRefGoogle ScholarPubMed
Menting, A. T. A., Orobio de Castro, B., Wijngaards-de Meij, L. D., & Matthys, W. (2014). A trial of parent training for mothers being released from incarceration and their children. Journal of Clinical Child and Adolescent Psychology, 43, 381396.CrossRefGoogle ScholarPubMed
Mikami, A. Y., Chong, G. K., Saporito, J. M., & Na, J. J. (2015). Implications of parental affiliate stigma in families of children with ADHD. Journal of Clinical Child & Adolescent Psychology, 44, 595603. doi:10.1080/15374416.2014.888665CrossRefGoogle ScholarPubMed
Moher, D., Schulz, K. F., Altman, D. G., & Lepage, L. (2001). The CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet, 357, 11911194. doi:10.1016/S0140-6736(00)04337-3CrossRefGoogle Scholar
Mouton, B., & Roskam, I. (2015). Confident mothers, easier children: A quasi-experimental manipulation of mothers’ self-efficacy. Journal of Child and Family Studies, 24, 24852495. doi:10.1007/s10826-014-0051-0CrossRefGoogle Scholar
Pek, J., & Hoyle, R. H. (2016). On the (in)validity of tests of simple mediation: Threats and solutions. Social and Personality Psychology Compass, 10, 150163. doi:10.1111/spc3.12237CrossRefGoogle Scholar
Posthumus, J. A., Raaijmakers, M. A. J., Maassen, G. H., van Engeland, H., & Matthys, W. (2012). Sustained effects of incredible years as a preventive intervention in preschool children with conduct problems. Journal of Abnormal Child Psychology, 40, 487500. doi:10.1007/s10802-011-9580-9CrossRefGoogle ScholarPubMed
Rimestad, M. L., O'Toole, M. S., & Hougaard, E. (2017). Mediators of change in a parent training program for early ADHD difficulties: The role of parental strategies, parental self-efficacy, and therapeutic alliance. Journal of Attention Disorders. Advance online publication. doi:10.1177/1087054717733043CrossRefGoogle Scholar
Ros, R., Hernandez, J., Graziano, P. A., & Bagner, D. M. (2016). Parent training for children with or at risk for developmental delay: The role of parental homework completion. Behavior Therapy, 47, 113. doi:10.1016/j.beth.2015.08.004CrossRefGoogle ScholarPubMed
Ryu, E., & Cheong, J. (2017). Comparing indirect effects in different groups in single-group and multi-group structural equation models. Frontiers in Psychology, 8, 747. doi:10.3389/fpsyg.2017.00747CrossRefGoogle ScholarPubMed
Salvatore, J. E., & Dick, D. M. (2015). Gene–Environment interplay: Where we are, where we are going. Journal of Marriage and the Family, 77, 344350. doi:10.1111/jomf.12164CrossRefGoogle ScholarPubMed
Selig, J. P., & Preacher, K. J. (2009). Mediation models for longitudinal data in developmental research. Research in Human Development, 6, 144164. doi:10.1080/15427600902911247CrossRefGoogle Scholar
Settipani, C. A., O'Neil, K. A., Podell, J. L., Beidas, R. S., & Kendall, P. C. (2013). Youth anxiety and parent factors over time: Directionality of change among youth treated for anxiety. Journal of Clinical Child & Adolescent Psychology, 42, 921. doi:10.1080/15374416.2012.719459CrossRefGoogle ScholarPubMed
Shaffer, A., Lindhiem, O., Kolko, D. J., & Trentacosta, C. J. (2013). Bidirectional relations between parenting practices and child externalizing behavior: A cross-lagged panel analysis in the context of a psychosocial treatment and 3-year follow-up. Journal of Abnormal Child Psychology, 41, 199210. doi:10.1007/s10802-012-9670-3CrossRefGoogle ScholarPubMed
Shelleby, E. C., & Shaw, D. S. (2014). Outcomes of parenting interventions for child conduct problems: A review of differential effectiveness. Child Psychiatry & Human Development, 45, 628645. doi:10.1007/s10578-013-0431-5CrossRefGoogle ScholarPubMed
Stone, C. A., & Sobel, M. E. (1990). The robustness of estimates of total indirect effects in covariance structure models estimated by maximum. Psychometrika, 55, 337352. doi:10.1007/BF02295291CrossRefGoogle Scholar
Te Brinke, L. W., Deković, M., Stoltz, S. E. M. J., & Cillessen, A. H. N. (2017). Bidirectional effects between parenting and aggressive child behavior in the context of a preventive intervention. Journal of Abnormal Child Psychology, 45, 921934. doi:10.1007/s10802-016-0211-3CrossRefGoogle ScholarPubMed
Van Aar, J., Leijten, P., Orobio de Casstro, B., Weeland, J., Matthys, W., Chhangur, R., & Overbeek, G. (2018). Families who benefit and families who do not: Integarting person- and variable-centered analyses of parenting intervention responses. Unpublished manuscript.Google Scholar
Vannest, K. J., & Ninci, J. (2015). Evaluating intervention effects in single-case research designs. Journal of Counseling & Development, 93, 403411. doi:10.1002/jcad.12038CrossRefGoogle Scholar
Weeland, J., Chhangur, R. R., Jaffee, S. R., van Der Giessen, D., Matthys, W., Orobio de Castro, B., & Overbeek, G. (2018). Does the Incredible Years reduce child externalizing problems through improved parenting? The role of child negative affectivity and serotonin transporter linked polymorphic region (5-HTTLPR) genotype. Development and Psychopathology, 30, 93112. doi:10.1017/S0954579417000499CrossRefGoogle ScholarPubMed
Weeland, J., Chhangur, R. R., van der Giessen, D., Matthys, W., Orobio de Castro, B., & Overbeek, G. (2017). Intervention effectiveness of the Incredible Years: New insights into sociodemographic and intervention-based moderators. Behavior Therapy, 48, 118. doi:10.1016/j.beth.2016.08.002CrossRefGoogle ScholarPubMed
Wu, W., Carroll, I. A., & Chen, P.-Y. (2017). A single-level random-effects cross-lagged panel model for longitudinal mediation analysis. Behavior Research Methods. Advance online publication. doi:10.3758/s13428-017-0979-2CrossRefGoogle ScholarPubMed
Cited by

Send article to Kindle

To send this article to your Kindle, first ensure is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

Note you can select to send to either the or variations. ‘’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

What changes when? A reply to Beauchaine and Slep
Available formats

Send article to Dropbox

To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

What changes when? A reply to Beauchaine and Slep
Available formats

Send article to Google Drive

To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

What changes when? A reply to Beauchaine and Slep
Available formats

Reply to: Submit a response

Please enter your response.

Your details

Please enter a valid email address.

Conflicting interests

Do you have any conflicting interests? *