Skip to main content Accessibility help

Predicting non-familial major physical violent crime perpetration in the US Army from administrative data

  • A. J. Rosellini (a1), J. Monahan (a2), A. E. Street (a3) (a4), S. G. Heeringa (a5), E. D. Hill (a1), M. Petukhova (a1), B. Y. Reis (a6), N. A. Sampson (a1), P. Bliese (a7), M. Schoenbaum (a8), M. B. Stein (a9) (a10), R. J. Ursano (a11) and R. C. Kessler (a1)...



Although interventions exist to reduce violent crime, optimal implementation requires accurate targeting. We report the results of an attempt to develop an actuarial model using machine learning methods to predict future violent crimes among US Army soldiers.


A consolidated administrative database for all 975 057 soldiers in the US Army in 2004–2009 was created in the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). Of these soldiers, 5771 committed a first founded major physical violent crime (murder-manslaughter, kidnapping, aggravated arson, aggravated assault, robbery) over that time period. Temporally prior administrative records measuring socio-demographic, Army career, criminal justice, medical/pharmacy, and contextual variables were used to build an actuarial model for these crimes separately among men and women using machine learning methods (cross-validated stepwise regression, random forests, penalized regressions). The model was then validated in an independent 2011–2013 sample.


Key predictors were indicators of disadvantaged social/socioeconomic status, early career stage, prior crime, and mental disorder treatment. Area under the receiver-operating characteristic curve was 0.80–0.82 in 2004–2009 and 0.77 in the 2011–2013 validation sample. Of all administratively recorded crimes, 36.2–33.1% (male-female) were committed by the 5% of soldiers having the highest predicted risk in 2004–2009 and an even higher proportion (50.5%) in the 2011–2013 validation sample.


Although these results suggest that the models could be used to target soldiers at high risk of violent crime perpetration for preventive interventions, final implementation decisions would require further validation and weighing of predicted effectiveness against intervention costs and competing risks.


Corresponding author

* Address for correspondence: R. C. Kessler, Ph.D., Department of Health Care Policy, Harvard Medical School, 180 Longwood Avenue, Boston, MA 02115, USA. (Email:


Hide All
Anderssen, E, Dyrstad, K, Westad, F, Martens, H (2006). Reducing over-optimism in variable selection by cross-model validation. Chemometrics and Intelligent Laboratory Systems 84, 6974.
Army Suicide Prevention Task Force (2010). Army Health Promotion, Risk Reduction, Suicide Prevention. Department of Defense: Washington, DC. Accessed March 1, 2015.
Berk, RA (2008). Statistical Learning from a Regression Perspective. Springer Verlag: New York, NY.
Berk, RA (2009). The role of race in forecasts of violent crime. Race and Social Problems 1, 231242.
Berk, RA, Bleich, J (2014). Forecasts of violence to inform sentencing decisions. Journal of Quantitative Criminology 30, 7996.
Bliese, PD, Halverson, RR, Schriesheim, CA (2002). Benchmarking multi-level methods in leadership: the articles, the model and the data set. Leadership Quarterly 13, 314.
Department of Defense Instruction (2014). DoD Workplace Violence Prevention and Response Policy ( Accessed 1 March 2015.
Department of the US Army (2012). Army 2020: Generating Health & Discipline in the Force ahead of the Strategic Reset. US Army: Washington, DC ( Accessed 1 March 2015.
Douglas, KS, Hart, SD, Webster, CD, Belfrage, H (2013). HCR-20V3 Assessing Risk for Violence-User Guide. Mental Health, Law, and Policy Institute, Simon Fraser University: Burnaby, BC, Canada.
Elbogen, EB, Cueva, M, Wagner, HR, Sreenivasan, S, Brancu, M, Beckham, JC, Van Male, L (2014 a). Screening for violence risk in military veterans: predictive validity of a brief clinical tool. American Journal of Psychiatry 171, 749757.
Elbogen, EB, Fuller, S, Johnson, SC, Brooks, S, Kinneer, P, Calhoun, PS, Beckham, JC (2010 a). Improving risk assessment of violence among military veterans: an evidence-based approach for clinical decision-making. Clinical Psychology Review 30, 595607.
Elbogen, EB, Johnson, SC, Newton, VM, Fuller, S, Wagner, HR, Beckham, JC (2013). Self-report and longitudinal predictors of violence in Iraq and Afghanistan war era veterans. Journal of Nervous and Mental Disease 201, 872876.
Elbogen, EB, Johnson, SC, Wagner, HR, Newton, VM, Timko, C, Vasterling, JJ, Beckham, JC (2012). Protective factors and risk modification of violence in Iraq and Afghanistan War veterans. Journal of Clinical Psychiatry 73, e767e773.
Elbogen, EB, Johnson, SC, Wagner, HR, Sullivan, C, Taft, CT, Beckham, JC (2014 b). Violent behaviour and post-traumatic stress disorder in US Iraq and Afghanistan veterans. British Journal of Psychiatry 204, 368375.
Elbogen, EB, Wagner, HR, Fuller, SR, Calhoun, PS, Kinneer, PM, Beckham, JC (2010 b). Correlates of anger and hostility in Iraq and Afghanistan war veterans. American Journal of Psychiatry 167, 10511058.
Fazel, S, Singh, JP, Doll, H, Grann, M (2012). Use of risk assessment instruments to predict violence and antisocial behaviour in 73 samples involving 24 827 people: systematic review and meta-analysis. British Medical Journal 345, e4692.
Fort Lee Human Resources (2014). Prevention of Workplace Violence Program. US Army: Fort Lee, Virginia ( Accessed 1 March 2015.
Foster, EM, Jones, D (2006). Can a costly intervention be cost-effective?: an analysis of violence prevention. Archives of General Psychiatry 63, 12841291.
Friedman, J, Hastie, T, Tibshirani, R (2010). Regularization paths for generalized linear models via coordinate descent. Journal of Statistical Software 33, 122.
Gallaway, MS, Fink, DS, Millikan, AM, Bell, MR (2012). Factors associated with physical aggression among US Army soldiers. Aggressive Behavior 38, 357367.
Golubnitschaja, O, Costigliola, V (2012). General report & recommendations in predictive, preventive and personalised medicine 2012: white paper of the European Association for Predictive, Preventive and Personalised Medicine. EPMA Journal 3, 14.
Hellmuth, JC, Stappenbeck, CA, Hoerster, KD, Jakupcak, M (2012). Modeling PTSD symptom clusters, alcohol misuse, anger, and depression as they relate to aggression and suicidality in returning US veterans. Journal of Traumatic Stress 25, 527534.
Higgins, N, Watts, D, Bindman, J, Slade, M, Thornicroft, G (2005). Assessing violence risk in general adult psychiatry. Psychiatric Bulletin 29, 131133.
Institute of Medicine (IOM) (2010). Returning Home from Iraq and Afghanistan: Preliminary Assessment of Readjustment Needs of Veterans, Service Members, and their Families. The National Academies Press: Washington, DC.
Jakupcak, M, Conybeare, D, Phelps, L, Hunt, S, Holmes, HA, Felker, B, Klevens, M, McFall, ME (2007). Anger, hostility, and aggression among Iraq and Afghanistan War veterans reporting PTSD and subthreshold PTSD. Journal of Traumatic Stress 20, 945954.
Kessler, RC, Colpe, LJ, Fullerton, CS, Gebler, N, Naifeh, JA, Nock, MK, Sampson, NA, Schoenbaum, M, Zaslavsky, AM, Stein, MB, Ursano, RJ, Heeringa, SG (2013). Design of the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). International Journal of Methods in Psychiatric Research 22, 267275.
Kessler, RC, Warner, CH, Ivany, C, Petukhova, MV, Rose, S, Bromet, EJ, Brown, M III, Cai, T, Colpe, LJ, Cox, KL, Fullerton, CS, Gilman, SE, Gruber, MJ, Heeringa, SG, Lewandowski-Romps, L, Li, J, Millikan-Bell, AM, Naifeh, JA, Nock, MK, Rosellini, AJ, Sampson, NA, Schoenbaum, M, Stein, MB, Wessely, S, Zaslavsky, AM, Ursano, RJ (2015). Predicting suicides after psychiatric hospitalization in US Army soldiers: the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). JAMA Psychiatry 72, 4957.
Killgore, WD, Cotting, DI, Thomas, JL, Cox, AL, McGurk, D, Vo, AH, Castro, CA, Hoge, CW (2008). Post-combat invincibility: violent combat experiences are associated with increased risk-taking propensity following deployment. Journal of Psychiatric Research 42, 11121121.
Kohavi, R (1995). A study of cross-validation and bootstrap for accuracy estimation and model selection. In Proceedings of the 14th International Joint Conference on Artificial Intelligence - Volume 2, pp. 11371143. Morgan Kaufmann Publishers Inc.: Montreal, Quebec, Canada.
Kraemer, HC (2009). Events per person-time (incidence rate): a misleading statistic? Statistics in Medicine 28, 10281039.
LeBlanc, MM, Kelloway, EK (2002). Predictors and outcomes of workplace violence and aggression. Journal of Applied Psychology 87, 444453.
Liaw, A, Wiener, M (2002). Classification and regression by randomForest. R News 2, 1822.
MacManus, D, Dean, K, Al Bakir, M, Iversen, AC, Hull, L, Fahy, T, Wessely, S, Fear, NT (2012 a). Violent behaviour in U.K. military personnel returning home after deployment. Psychological Medicine 42, 16631673.
MacManus, D, Dean, K, Iversen, AC, Hull, L, Jones, N, Fahy, T, Wessely, S, Fear, NT (2012 b). Impact of pre-enlistment antisocial behaviour on behavioural outcomes among U.K. military personnel. Social Psychiatry and Psychiatric Epidemiology 47, 13531358.
MacManus, D, Dean, K, Jones, M, Rona, RJ, Greenberg, N, Hull, L, Fahy, T, Wessely, S, Fear, NT (2013). Violent offending by UK military personnel deployed to Iraq and Afghanistan: a data linkage cohort study. Lancet 381, 907917.
MacManus, D, Rona, R, Dickson, H, Somaini, G, Fear, N, Wessely, S (2015). Aggressive and violent behavior among military personnel deployed to Iraq and Afghanistan: prevalence and link with deployment and combat exposure. Epidemiologic Reviews 37, 196212.
Marshall, AD, Panuzio, J, Taft, CT (2005). Intimate partner violence among military veterans and active duty servicemen. Clinical Psychology Review 25, 862876.
Meloy, JR, White, SG, Hart, S (2013). Workplace assessment of targeted violence risk: the development and reliability of the WAVR-21. Journal of Forensic Sciences 58, 13531358.
Millikan, AM, Bell, MR, Gallaway, MS, Lagana, MT, Cox, AL, Sweda, MG (2012). An epidemiologic investigation of homicides at Fort Carson, Colorado: summary of findings. Military Medicine 177, 404411.
Mohammadkhani, P, Forouzan, AS, Khooshabi, KS, Assari, S, Lankarani, MM (2009). Are the predictors of sexual violence the same as those of nonsexual violence? A gender analysis. Journal of Sexual Medicine 6, 22152223.
Monahan, J, Skeem, JL (2014). Risk redux: the resurgence of risk assessment in criminal sanctioning. Federal Sentencing Reporter 26, 158166.
Monahan, J, Steadman, HJ, Robbins, PC, Appelbaum, P, Banks, S, Grisso, T, Heilbrun, K, Mulvey, EP, Roth, L, Silver, E (2005). An actuarial model of violence risk assessment for persons with mental disorders. Psychiatric Services 56, 810815.
Naeem, F, Clarke, I, Kingdon, D (2009). A randomized controlled trial to assess an anger management group programme. The Cognitive Behaviour Therapist 2, 2031.
Parmak, M, Euwema, MC, Mylle, JJC (2012). Changes in sensation seeking and need for structure before and after a combat deployment. Military Psychology 24, 551564.
SAS Institute Inc. (2010). SAS/STATR Software. SAS Institute Inc.: Cary, NC.
Schlesselman, JJ (1982). Case-control Studies: Design, Conduct, Analysis. Oxford University Press: New York.
Shamir, B, Brainin, E, Zakay, E, Popper, M (2000). Perceived combat readiness as collective efficacy: individual-and group-level analysis. Military Psychology 12, 105119.
Shea, MT, Lambert, J, Reddy, MK (2013). A randomized pilot study of anger treatment for Iraq and Afghanistan veterans. Behaviour Research and Therapy 51, 607613.
Skeem, JL, Kennealy, P, Monahan, J, Peterson, J, Appelbaum, P (2015). Psychosis uncommonly and inconsistently precedes violence among high-risk individuals. Clinical Psychological Science ( Accessed 1 August 2015.
Skeem, JL, Monahan, J (2011). Current directions in violence risk assessment. Current Directions in Psychological Science 20, 3842.
Steadman, HJ, Monahan, J, Pinals, DA, Vesselinov, R, Robbins, PC (2015). Gun violence and victimization of strangers by persons with a mental illness: data from the MacArthur violence risk assessment study. Psychiatric Services ( Accessed 1 August 2015.
Stine, RA (1995). Graphical interpretation of variance inflation factors. The American Statistician 49, 5356.
Sullivan, CP, Elbogen, EB (2014). PTSD symptoms and family versus stranger violence in Iraq and Afghanistan veterans. Law and Human Behavior 38, 19.
Sundin, J, Herrell, RK, Hoge, CW, Fear, NT, Adler, AB, Greenberg, N, Riviere, LA, Thomas, JL, Wessely, S, Bliese, PD (2014). Mental health outcomes in US and UK military personnel returning from Iraq. British Journal of Psychiatry 204, 200207.
Svetnik, V, Liaw, A, Tong, C, Culberson, JC, Sheridan, RP, Feuston, BP (2003). Random forest: a classification and regression tool for compound classification and QSAR modeling. Journal of Chemical Information and Computer Sciences 43, 19471958.
Thomas, JL, Wilk, JE, Riviere, LA, McGurk, D, Castro, CA, Hoge, CW (2010). Prevalence of mental health problems and functional impairment among active component and National Guard soldiers 3 and 12 months following combat in Iraq. Archives of General Psychiatry 67, 614623.
US Department of Justice (2009). National Corrections Reporting Program, 2009 (ICPSR 30799). National Achive of Criminal Justice Data: Ann Arbor, MI. Accessed 1 March 2015.
Ursano, RJ, Colpe, LJ, Heeringa, SG, Kessler, RC, Schoenbaum, M, Stein, MB (2014). The army study to assess risk and resilience in Servicemembers (Army STARRS). Psychiatry 77, 107119.
Whittington, R, Hockenhull, JC, McGuire, J, Leitner, M, Barr, W, Cherry, MG, Flentje, R, Quinn, B, Dundar, Y, Dickson, R (2013). A systematic review of risk assessment strategies for populations at high risk of engaging in violent behaviour: update 2002–8. Health Technology Assessment 17, i-xiv, 1128.
Willett, JB, Singer, JD (1993). Investigating onset, cessation, relapse, and recovery: why you should, and how you can, use discrete-time survival analysis to examine event occurrence. Journal of Consulting Clinical Psychology 61, 952965.
Zou, H, Hastie, T (2005). Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B 67, 301320.


Type Description Title
Supplementary materials

Rosellini supplementary material
Appendix Tables 1-24 and Appendix Figure 1

 Word (267 KB)
267 KB


Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed