Hostname: page-component-7c8c6479df-995ml Total loading time: 0 Render date: 2024-03-28T12:04:24.141Z Has data issue: false hasContentIssue false

2469

Streamlining study design and statistical analysis for quality improvement and research reproducibility

Published online by Cambridge University Press:  10 May 2018

Ram Gouripeddi
Affiliation:
The University of Utah School of Medicine, Salt Lake City, UT, USA
Mollie Cummins
Affiliation:
The University of Utah School of Medicine, Salt Lake City, UT, USA
Randy Madsen
Affiliation:
The University of Utah School of Medicine, Salt Lake City, UT, USA
Bernie LaSalle
Affiliation:
The University of Utah School of Medicine, Salt Lake City, UT, USA
Andrew Middleton Redd
Affiliation:
The University of Utah School of Medicine, Salt Lake City, UT, USA
Angela Paige Presson
Affiliation:
The University of Utah School of Medicine, Salt Lake City, UT, USA
Xiangyang Ye
Affiliation:
The University of Utah School of Medicine, Salt Lake City, UT, USA
Julio C. Facelli
Affiliation:
The University of Utah School of Medicine, Salt Lake City, UT, USA
Tom Green
Affiliation:
The University of Utah School of Medicine, Salt Lake City, UT, USA
Steve Harper
Affiliation:
The University of Utah School of Medicine, Salt Lake City, UT, USA
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

OBJECTIVES/SPECIFIC AIMS: Key factors causing irreproducibility of research include those related to inappropriate study design methodologies and statistical analysis. In modern statistical practice irreproducibility could arise due to statistical (false discoveries, p-hacking, overuse/misuse of p-values, low power, poor experimental design) and computational (data, code and software management) issues. These require understanding the processes and workflows practiced by an organization, and the development and use of metrics to quantify reproducibility. METHODS/STUDY POPULATION: Within the Foundation of Discovery – Population Health Research, Center for Clinical and Translational Science, University of Utah, we are undertaking a project to streamline the study design and statistical analysis workflows and processes. As a first step we met with key stakeholders to understand the current practices by eliciting example statistical projects, and then developed process information models for different types of statistical needs using Lucidchart. We then reviewed these with the Foundation’s leadership and the Standards Committee to come up with ideal workflows and model, and defined key measurement points (such as those around study design, analysis plan, final report, requirements for quality checks, and double coding) for assessing reproducibility. As next steps we are using our finding to embed analytical and infrastructural approaches within the statisticians’ workflows. This will include data and code dissemination platforms such as Box, Bitbucket, and GitHub, documentation platforms such as Confluence, and workflow tracking platforms such as Jira. These tools will simplify and automate the capture of communications as a statistician work through a project. Data-intensive process will use process-workflow management platforms such as Activiti, Pegasus, and Taverna. RESULTS/ANTICIPATED RESULTS: These strategies for sharing and publishing study protocols, data, code, and results across the spectrum, active collaboration with the research team, automation of key steps, along with decision support. DISCUSSION/SIGNIFICANCE OF IMPACT: This analysis of statistical methods and process and computational methods to automate them ensure quality of statistical methods and reproducibility of research.

Type
Biomedical Informatics/Health Informatics
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
© The Association for Clinical and Translational Science 2018