Hostname: page-component-848d4c4894-ndmmz Total loading time: 0 Render date: 2024-05-11T14:16:10.864Z Has data issue: false hasContentIssue false

Open Science for Non-Specialists: Making Open Science Meaningful Beyond the Scientific Community

Published online by Cambridge University Press:  24 May 2022

Kevin C. Elliott*
Affiliation:
Michigan State University, East Lansing, MI, US
*
Rights & Permissions [Opens in a new window]

Abstract

A major goal of the open science movement is to make more scientific information available to non-specialists, but it has been difficult to meaningfully achieve that goal. In response, this paper argues for two steps: (1) focusing on the scientific content that is most relevant to non-specialist audiences; and (2) packaging that content in meaningful ways for those audiences. The paper uses a case study involving a major environmental health issue (namely, PFAS pollution) to illustrate how the proponents of open science can work with groups like government agencies, nongovernmental organizations, and extension services to implement these two steps.

Type
Symposia Paper
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2022. Published by Cambridge University Press on behalf of the Philosophy of Science Association

1. Introduction

The open science movement is a major trend in contemporary scientific practice. According to a report from the National Academy of Sciences, “Open science aims to ensure the free availability and usability of scholarly publications, the data that result from scholarly research, and the methodologies, including code or algorithms, that were used to generate those data” (NAS 2018, 1). Open science can include a wide variety of activities: making scientific data and research materials more widely available (Leonelli Reference Leonelli2016), preregistering studies before performing them (Kupferschmidt Reference Kupferschmidt2018), discussing study designs and techniques with others while performing experiments (Schapira and Harding Reference Schapira and Harding2019), posting preprints before studies are published (Callaway Reference Callaway2013), making published papers freely available (Else Reference Else2018), and making peer review processes more transparent (Ross-Hellauer Reference Ross-Hellauer2017). Major motivations for this movement include speeding scientific innovation, making scientific results more reproducible, and providing greater public access to scientific information (see, e.g., NAS 2018; Royal Society 2012).

Despite the importance of this movement for the scientific community and for society at large, it has received little attention in the philosophical literature. One of the few philosophers to focus on this topic is Sabina Leonelli, who has scrutinized open data initiatives in her book, Data-Centric Biology: A Philosophical Study (Reference Leonelli2016). She has also examined open science more broadly in a series of articles (e.g., Bezuidenhout et al. Reference Bezuidenhout, Kelly, Leonelli and Rappert2017; Leonelli et al. Reference Leonelli, Spichtinger and Prainsack2015; Levin and Leonelli Reference Levin and Leonelli2017). One of the important themes in her work is that the goals of the open science movement cannot be achieved solely by placing scientific information in the public domain. Rather, for scientific information to be meaningful to recipients it needs to be labeled appropriately (Leonelli Reference Leonelli2016), and those receiving it need access to resources for interpreting it (Bezuidenhout et al. Reference Bezuidenhout, Kelly, Leonelli and Rappert2017). Building on this insight that open science initiatives need to be designed in ways that make information meaningful for target audiences, David Resnik and I (Elliott and Resnik Reference Elliott and Resnik2019) have raised the worry that most open science initiatives are designed primarily for the benefit of expert scientists rather than for non-specialist audiences.

In response to our concerns, this paper examines how the proponents of open science can better achieve the goal of providing information in a manner that is meaningful to non-specialists. Section 2 argues for two steps: (1) placing greater focus on the kinds of scientific content that are most relevant for non-specialist audiences; and (2) focusing more attention on packaging that information in a manner that is meaningful to those audiences. Section 3 examines a case study about the emerging human health hazards associated with per- and polyfluorinated alkyl substances (PFAS) in order to illustrate some of the measures that could be taken to implement these two steps. The case study shows that the proponents of open science can advance their goals of making scientific information available and meaningful for non-specialists by working strategically with organizations like government agencies, nongovernmental organizations (NGOs), and extension services.

2. Open science for non-specialists

One of the significant limitations of the open science movement is that even though its proponents emphasize the goal of making information available to non-specialists, the major initiatives associated with the movement are not well designed for meaningfully achieving that goal (Elliott and Resnik Reference Elliott and Resnik2019). As emphasized by a European Commission-funded research project called FOSTER Plus, the two open science initiatives that receive the most focus are open data (i.e., making the data underlying publications publicly available) and open access to scientific publications (i.e., making publications available without “paywalls” [de la Fuente, Reference de la Fuenten.d.]). It is fairly obvious, however, that open data are of little use to most non-specialists because most people have very limited abilities to understand or make use of large, complex scientific databases. Making scientific publications freely available is somewhat more useful, but most people are still unlikely to understand the details of those publications. Other initiatives that are commonly discussed as part of the open science movement (e.g., preprint servers, registries of trials, open lab notebooks, and open peer-review processes [Brock et al. Reference Brock, Elliott, Gladbach, Moermond, Romeis, Seiler, Solomon and Dohmen2021]) are similarly opaque to most non-specialists.

One could argue, of course, that having this information openly available can help non-specialists in indirect ways. For example, making the data that underlie scientific studies publicly available could enable other researchers to scrutinize the data and identify weaknesses in those studies, thereby ultimately benefiting non-specialists. This is probably true, but it does not capture the lofty goals of many proponents of open science. In its influential overview of open science, for instance, the British Royal Society stated, “A realistic means of making data open to the wider public needs to ensure that the data that are most relevant to the public are accessible, intelligible, assessable and usable for the likely purposes of non-specialists” (Royal Society 2012, 8). This quotation clearly expresses the goal of making scientific materials like data directly usable by interested members of the public.

This paper argues for two steps that can help make open science more meaningful to non-specialists. First, the movement can place greater focus on the kinds of scientific content that are most relevant to non-specialist audiences. Second, they can focus more attention on packaging that content in meaningful ways for those audiences. Both steps have been discussed in the broader literature on science communication and knowledge translation (see, e.g., Bubela et al. Reference Bubela, Nisbet, Borchelt, Brunger, Crichley and Einsiedel2009; Grimshaw et al. Reference Grimshaw, Eccles, Lavis, Hill and Squires2012). However, these steps have not been emphasized in discussions of open science or connected to the philosophical literature. This section introduces both of these steps, and the following section illustrates how the proponents of open science can potentially work with a range of organizations to help achieve them.

2.1 Content

In the course of critiquing the open science movement, David Resnik and I (Elliott and Resnik Reference Elliott and Resnik2019) hint at a solution that could alleviate our worries. We clarify that most people do not care about all the details released as part of open science initiatives; rather, people typically care about the “take-home lessons” from scientific research projects and the major value judgments associated with those lessons (Elliott and Resnik Reference Elliott and Resnik2019, 3). Building on this point, one way to make the open science movement more relevant to non-specialists is to consider the content that is most useful and relevant to specific non-specialist audiences and develop initiatives that focus on communicating that content. As a starting point, this paper focuses on two kinds of content: important value judgments and personally relevant data.

The recent philosophical literature on value judgments in science is extensive (see, e.g., Brown Reference Brown2020; Douglas Reference Douglas2009; Elliott Reference Elliott2017). This literature has shown that scientists make a wide array of judgments that can have important social ramifications. For non-specialists trying to make decisions that draw on scientific information, these judgments can be extremely important. For example, depending on the situation, people might want to know the major strengths and weaknesses of the available scientific information, the reasons why some studies disagree with others, the major gaps in existing evidence, or the major issues on which scientists agree and disagree. Science journalists can sometimes play an important role in making this information available to the public (Elliott Reference Elliott2019), but given the fragility and upheavals in contemporary journalism (Bubela et al. Reference Bubela, Nisbet, Borchelt, Brunger, Crichley and Einsiedel2009), it is important to consider a variety of avenues for making this content available to those who need it.

Another important kind of content that often matters to non-specialists is personally relevant data. Even though most people have little interest in all the data underlying scientific studies, they do frequently care about specific kinds of data that are relevant to their health or well-being. For example, during surges in the COVID-19 pandemic, people cared deeply about the infection rates in their states and cities, and during the water crisis in Flint, Michigan, residents wanted to know the lead levels in their drinking water. In general, people also care about their personal medical data and the ways those data could help them make better decisions about their healthcare. Of course, this data can still be difficult to digest and understand, which is part of why it is not only important to focus open science initiatives on the content that matters to people but also on the best ways of packaging that content.

2.2 Packaging

In addition to developing initiatives that focus on the content that is most relevant to specific non-specialist audiences, the open science movement can enhance its relevance by “packaging” information in meaningful ways. The concept of packaging used in this paper is multi-faceted; it can include not only the analysis and description of scientific content but also the people or institutions who provide it. Thus, the framing of scientific information is one aspect of packaging (Bubela et al. Reference Bubela, Nisbet, Borchelt, Brunger, Crichley and Einsiedel2009), but it is just one of many factors to consider. This paper’s discussion is inspired by Leonelli’s analysis of the systems used for packaging open data (see, e.g., Leonelli Reference Leonelli2016). Her starting point is the assertion that “making data available online does not automatically make them usable” (Leonelli Reference Leonelli2016, 25). In other words, it is not enough merely to encourage or require scientists to make their data publicly available in repositories; those data need to be organized in ways that make them meaningful to others. Two important elements of the packaging system discussed by Leonelli are labels and curators. The creation of labels involves both the use of “bio-ontologies” (i.e., terms that refer to each entity or process under investigation) and metadata (i.e., descriptions of the conditions under which data were obtained). Database curators are in charge of “decontextualizing” data so that they can be used beyond the settings in which they were originally collected, and they also help database users to “recontextualize” the data for use in new contexts (Leonelli Reference Leonelli2016, 30-31). As Leonelli puts it, the careers of these curators “depend at least in part on their ability to identify, embrace, and constructively engage with as many epistemic cultures in biology as possible” (Reference Leonelli2016, 32).

In addition to discussing the roles played by labeling systems and curators, Leonelli (Reference Leonelli2016) also emphasizes the importance of institutions and organizations that facilitate the transfer of data from one context to another. She focuses especially on bio-ontology consortia, which are organizations that help develop the labels and standards used by databases. These consortia, like the Open Biomedical Ontology consortium or the Gene Ontology consortium, provide opportunities for two-way communication among data curators, data users, and those who play a regulatory role in open data initiatives (e.g., journal editors and funders). Leonelli also discusses less formal social media structures like wikis, which provide additional opportunities to crowdsource the tasks associated with curating and annotating data (Leonelli Reference Leonelli2016, 54).

These lessons about the importance of packaging are just as relevant (if not more so) for those seeking to make scientific content available to non-specialists. For scientific information to be useful to such groups, a variety of conditions need to be met. People need to be aware of the information. They also need to have access to it (e.g., through websites or social media or newspapers or print sources). In addition, the information needs to be understandable and contextualized in a meaningful way. Significantly, just as curators need to understand different groups of scientists in order to help them decontextualize and recontextualize information for their purposes, the open science movement needs people who can play the same role for non-specialist audiences. Information that might not otherwise be particularly helpful for non-specialists (e.g., open access papers or trial registries or online databases of scientific data) can become useful if they are explained, interpreted, and contextualized appropriately. As the literature on knowledge translation puts it, “research knowledge infrastructures” (i.e., systems of technical tools, programs, and people) are needed to facilitate the effective transfer of scientific information (Grimshaw et al. Reference Grimshaw, Eccles, Lavis, Hill and Squires2012). The following section uses a concrete case study to illustrate what this packaging of relevant scientific content can look like and to explore some of the existing organizations that can make this possible.

3. A case study: communicating about PFAS chemicals

As the open science movement strives to communicate information more effectively to non-specialist audiences, it can build on a number of initiatives that are already taking place. This section uses a case study involving toxic chemicals called PFAS to show how three kinds of organizations (government agencies, NGOs, and extension services) can help achieve the two steps described in the previous section: (1) communicating scientific content that matters to non-specialists; and (2) packaging that content in meaningful ways. Thus, those who seek to promote open science for non-specialists can collaborate with these organizations and strengthen their work.

Human exposure to PFAS is one of the most important issues in contemporary environmental health research and policy (Blum et al. Reference Blum, Balan, Scheringer, Trier, Goldenman, Cousins, Diamond, Fletcher, Higgins, Lindeman, Peaslee, Voogt, Wang and Weber2015). PFAS are organic molecules made up of chains of carbon atoms bonded to fluorine atoms and other chemical groups. They have stain- and water-repellent properties that have made them a popular component in non-stick cookware, stain-resistant carpets, water-repellent clothing, food-packaging material, and fire-fighting foams (Buck et al. Reference Buck, Franklin, Berger, Conder, Cousins, De Voogt, Jensen, Kannan, Mabury and van Leeuwen2011). Unfortunately, because of the strength of carbon-fluorine bonds, these chemicals are extremely difficult to break down, and thus they are highly persistent in the environment (Cordner et al. Reference Cordner, De La Rosa, Schaider, Rudel, Richter and Brown2019). These chemicals also tend to bioaccumulate in living organisms, and some of them cause health problems such as high cholesterol, cancer, problems with immune function, and low infant birth weight (Blum et al. Reference Blum, Balan, Scheringer, Trier, Goldenman, Cousins, Diamond, Fletcher, Higgins, Lindeman, Peaslee, Voogt, Wang and Weber2015). People are exposed to these chemicals through daily activities as well as through releases from contaminated sites. More than six million U.S. residents appear to be exposed to problematic levels of PFAS in their drinking water (Hu et al. Reference Hu, Andrews, Lindstrom, Bruton, Schaider, Grandjean, Lohmann, Carignan, Blum, Balan, Higgins and Sunderl2016), and some communities (e.g., those living near military bases or airports that release fire-fighting foams into the environment) face particularly high levels of exposure. Two of the most studied PFAS compounds, perfluorooctanoic acid (PFOA) and perfluorooctanesulfonic acid (PFOS), have been voluntarily phased out of use by industry (Cordner et al. Reference Cordner, De La Rosa, Schaider, Rudel, Richter and Brown2019), but there are thousands of chemicals in the PFAS family, and relatively little is known about many of them. This section explores how government agencies, NGOs, and extension agencies engage in activities that proponents of open science can build on to make their work meaningful to non-specialists.

A Government Agency: The Agency for Toxic Substances and Disease Registry (ATSDR)

The ATSDR is a U.S. federal agency associated with the Centers for Disease Control (CDC). Its mission is to help communities address hazards posed by natural and human-made substances, including emergencies posed by spills or chemical releases. ATSDR’s communication efforts related to PFAS illustrate not only efforts to make relevant content known to different communities but also strategic packaging of that content. First, the ATSDR provides basic information about PFAS on its website in an easy-to-understand format for members of the public who want relatively simple information (Agency for Toxic Substances and Disease Registry [ATSDR], “What are the health effects of PFAS?” n.d.). For those who want somewhat more detailed information, the ATSDR gives people advice about how to talk to their physicians about potential PFAS exposures (ATSDR, “Talking to Your Doctor about Exposure to PFAS,” n.d.). This is an important step because physicians can potentially contextualize (i.e., package) scientific information about PFAS and explain it in an understandable and relevant manner that meets the needs of specific patients. To assist with this process, the ATSDR provides a fact sheet to update physicians on scientific findings about PFAS (ATSDR 2019).

The ATSDR’s fact sheet for physicians provides a further illustration of how science communicators can attend both to relevant content and to the packaging of that content. With respect to content, the fact sheet not only provides an overview of animal and human studies regarding the potential health effects of PFAS, but it also highlights important value judgments that could be relevant to physicians and patients. For example, it clarifies that most of these studies identify correlations rather than establishing causal relationships, it identifies cases where different studies provide conflicting results, and it distinguishes cases where there is stronger versus weaker evidence. With respect to packaging, the fact sheet takes evidence that is already in the public domain (e.g., open access publications) and digests it in a manner that is understandable for physicians. In 2020, the ATSDR solicited guidance from a committee of the U.S. National Academy of Sciences (NAS) in order to update its fact sheet to reflect the latest evidence about PFAS (NAS, n.d.). The NAS committee waded through a great deal of published information that would have been difficult for most physicians and patients to understand and evaluate. By working with the NAS, the ATSDR sought to package the available information about PFAS in a manageable format for physicians so that those physicians could in turn pass on the most relevant information in an understandable way to their patients.

An NGO: The Silent Spring Institute

NGOs can also play a particularly valuable role in making information accessible and usable by non-specialists. The Silent Spring Institute is an NGO that has been particularly engaged in communicating about PFAS. Silent Spring was founded in 1994 in response to community concerns about high breast cancer rates in towns on Cape Cod, Massachusetts. Since its founding, the institute has broadened its focus to include a variety of health effects related to chemical exposures. One of Silent Spring’s distinctive features is its emphasis on community-engaged research projects, which provide opportunities for members of the public to collaborate with scientists on research projects that address their concerns. These projects provide unique opportunities for identifying content that matters to particular individuals or groups and packaging it in ways that are meaningful to them. For example, the institute has organized a crowd-sourced biomonitoring study that measures people’s exposure to ten common toxic chemicals. Members of the public can pay to submit urine samples using kits developed by the institute, and they receive personalized reports with their results, including guidance on ways to reduce their exposure to the tested chemicals (Silent Spring Institute, “Detox Me Action Kit,” n.d.). Thus, in addition to producing general scientific knowledge about the public’s chemical exposures, this project provides scientific content that matters to people (i.e., personally relevant data) and packages it in a meaningful way (namely, by contextualizing the data in a manner so that people can alter their behaviors and enhance their health).

Silent Spring is involved in a similar community-engaged research project in the case of PFAS. The PFAS-REACH project is a collaboration between scientists at Silent Spring, Michigan State University, and Northeastern University. The project has three main goals: (1) to assess the effects of PFAS exposures on children in two communities that have been exposed to high levels of water contamination; (2) to develop an online center (Silent Spring Institute, “The PFAS Exchange,” n.d.) with information resources for contaminated communities; and (3) to conduct a social-science analysis of the effects of contamination on these communities (Silent Spring Institute, “PFAS-REACH,” n.d.). As part of the project, the investigators are committed to reporting back individual results to participants about their PFAS exposures, and they are designing their online information center to help the participants (and other members of the public who are tested for PFAS exposures) interpret their results. Thus, as in the case of Silent Spring’s other community-engaged research projects, this project provides an excellent example of supplying relevant content (i.e., personally relevant data) and packaging it in a meaningful way.

An Extension Service: Michigan State University Extension

Another avenue through which publics can obtain information about PFAS is extension services. In the United States, the Smith-Lever Act of 1914 created a system of extension services connected to the land-grant university in each state. The goal of the Smith-Lever Act was to promote the flow of information from researchers working in these universities to farmers and other community members who could benefit from their research. Traditionally, the extension services included offices in every county of every state, and they focused particularly on food and agricultural issues. They have expanded their focus over time to include educational opportunities for both children and adults related to a range of environmental and economic topics. Some of the scientists working for extension services are county extension agents (based in local county offices), while others are extension specialists who work in departments at the land-grant universities (Bursten and Kendig Reference Bursten and Kendig2021). This provides a unique system for communicating relevant scientific content and packaging it in ways that matter to specific non-specialist communities.

For example, in the state of Michigan, high levels of PFAS contamination have been identified in the waterways surrounding the now-closed Wurtsmith Air Force Base, where PFAS-laden fire-fighting foams were released into the environment. Another major contamination site is in Kent County, Michigan, where there is widespread PFAS contamination from waste disposal associated with the Wolverine World Wide Tannery. The people living in these affected communities are highly motivated to gain greater knowledge about PFAS so they can reduce their personal exposures and engage in more effective community activism to force the clean-up of contaminated sites. Michigan State University (MSU) recently created a Center for PFAS Research, which provides an excellent potential resource for these community members who want to obtain cutting-edge information from experts studying PFAS. Nevertheless, mechanisms are needed for connecting the members of affected communities with the Center and its researchers.

The MSU extension service provides one avenue for creating these connections. For example, the MSU Center for PFAS Research includes an extension specialist. As part of their communication efforts, this specialist organized a series of meetings designed to inform county extension agents about the latest scientific information regarding PFAS.Footnote 1 Some of those meetings included university researchers studying PFAS, representatives from the state task force working on PFAS, and even staff from the office of one of the state’s federal senators. The extension specialist also organized “Speed Meetings” (similar to speed dating) to introduce county extension agents to university researchers working on PFAS. One of the goals of these efforts was to create a situation in which community members could reach out to their county extension agents for assistance, and those agents would be equipped to either answer questions directly or reach out to university scientists they knew who could help them identify and interpret the desired information. In this way, extension specialists and county extension agents play a role much like the curators of the databases discussed by Leonelli (Reference Leonelli2016), insofar as they link those who produce scientific content with those who need it while helping to package the content in meaningful ways.

Opportunities for the open science movement

This brief examination of the PFAS case illustrates that the proponents of open science can potentially make progress in achieving the two steps described in section 2 by collaborating with organizations like government agencies, NGOs, and extension agencies and strengthening their activities that contribute to open science. For example, those seeking to promote open science could encourage government agencies to use their significant financial resources to make the scientific information at their disposal more useful to non-specialist audiences (just as the ATSDR did by convening an NAS committee to improve their fact sheet). Along these lines, the U.S. National Aeronautics and Space Administration (NASA) recently launched an excellent initiative called HAQAST. It funds university researchers to use NASA’s publicly available data to answer questions that local communities have about their air quality (Holloway et al. Reference Holloway, Jacob and Daegan2018). This is an excellent example of an effort to take openly accessible government data that would otherwise be of little use for non-specialists and packaging it (i.e., analyzing and interpreting it) in ways that matter to specific non-specialist communities.

Proponents of open science can also support the work of NGOs, which are often uniquely suited to identify scientific content that matters to non-specialist audiences and package the information in meaningful ways. Unfortunately, they often have limited funds available to do their work. Highlighting their contributions to open science could help justify additional funding for them. For example, the U.S. National Institute of Environmental Health Sciences (NIEHS) typically focuses on university research projects, but because of the Silent Spring Institute’s ability to enhance the PFAS-REACH project’s outreach to affected communities, the NIEHS is helping to support this NGO’s work.

Proponents of open science could also help to revitalize extension services. These services have struggled to maintain their funding and justify their relevance in recent years (Rivera Reference Rivera2011; Wang Reference Wang2014), resulting in lost staff and less ability to engage with community members. Nevertheless, as discussed earlier in this section, these services could help achieve meaningful open science for non-specialist audiences. Extension services are not only able to provide unique opportunities for two-way communication between non-specialists and university researchers, but they can also facilitate community-engaged research projects much like those organized by the Silent Spring Institute (van de Gevel et al. Reference Van De Gevel, van Etten and Deterding2020).

4. Conclusion

This paper explored how the open science movement can become more meaningful to non-specialists. It argued for two steps: (1) placing greater focus on the kinds of scientific content that are most relevant to non-specialist audiences; and (2) focusing more attention on packaging that content in ways that are meaningful for those audiences. It used a case study involving science communication efforts about the health hazards associated with PFAS to illustrate how the proponents of open science can help achieve these steps by working strategically with organizations like government agencies, NGOs, and extension services.

Acknowledgments

I am grateful to my fellow participants in our symposium session at PSA 2020/2021 (Carole Lee, Sabina Leonelli, Felipe Romero, and Pat Soranno) for their helpful comments on this paper. The paper also benefited from the feedback of two anonymous reviewers. Finally, my work on this project was deeply informed by all that I learned from my colleagues associated with the MSU Center for PFAS Research and the NAS Committee on Guidance on PFAS Testing and Health Outcomes.

Footnotes

1 The information in this paragraph was obtained through personal communication with Lois Wolfson on February 11, 2021.

References

Agency for Toxic Substances and Disease Registry (ATSDR). n.d. “What are the health effects of PFAS?” Accessed June 23, 2022. https://www.atsdr.cdc.gov/pfas/health-effects/index.html.Google Scholar
Agency for Toxic Substances and Disease Registry (ATSDR). n.d. “Talking to Your Doctor about Exposure to PFAS.” Accessed June 23, 2022. https://www.atsdr.cdc.gov/pfas/health-effects/talk-to-your-doctor.html.Google Scholar
Agency for Toxic Substances and Disease Registry (ATSDR). 2019. “An Overview of the Science and Guidance for Clinicians on PFAS.” Accessed June 23, 2022. https://www.atsdr.cdc.gov/pfas/docs/clinical-guidance-12-20-2019.pdf.Google Scholar
Bezuidenhout, Louise, Kelly, Ann, Leonelli, Sabina, and Rappert, Brian. 2017. “‘$100 Is Not Much to You’: Open Science and Neglected Accessibilities for Scientific Research in Africa.” Critical Public Health 27 (1):3949.CrossRefGoogle Scholar
Blum, Arlene, Balan, Simona A., Scheringer, Martin, Trier, Xenia, Goldenman, Gretta, Cousins, Ian T., Diamond, Miriam, Fletcher, Tony, Higgins, Christopher, Lindeman, Avery E., Peaslee, Graham, Voogt, Pim de, Wang, Zhanyun, and Weber, Roland. 2015. “The Madrid Statement on Poly- and Perfluoroalkyl Substances (PFASs).” Environmental Health Perspectives 123 (5):A107A111.CrossRefGoogle ScholarPubMed
Brock, Theo, Elliott, Kevin, Gladbach, Anja, Moermond, Caroline, Romeis, Jörg, Seiler, Thomas-Benjamin, Solomon, Keith, and Dohmen, G. Peter. 2021. “Open Science in Regulatory Environmental Risk Assessment.” Integrated Environmental Assessment and Management 17 (6):1229–42. https://doi.org/10.1002/ieam.4433 CrossRefGoogle ScholarPubMed
Brown, Matthew. 2020. Science and Moral Imagination. Pittsburgh: University of Pittsburgh Press.CrossRefGoogle Scholar
Bubela, Tania, Nisbet, Matthew, Borchelt, Rick, Brunger, Fern, Crichley, Christine, Einsiedel, Edna, et al. 2009. “Science Communication Reconsidered.” Nature Biotechnology 27 (6): 514–18.CrossRefGoogle ScholarPubMed
Buck, Robert C., Franklin, James, Berger, Urs, Conder, Jason M., Cousins, Ian T., De Voogt, Pim, Jensen, Allan Astrup, Kannan, Kurunthachalam, Mabury, Scott A., and van Leeuwen, Stefan P. J.. 2011. “Perfluoroalkyl and Polyfluoroalkyl Substances in the Environment: Terminology, Classification, and Origins.” Integrated Environmental Assessment and Management 7 (4):513–41.CrossRefGoogle ScholarPubMed
Bursten, Julia, and Kendig, Catherine. 2021. “Growing Knowledge: Epistemic Objects in Agricultural Extension Work.” Studies in History and Philosophy of Science 88 (August):8591. https://doi.org/10.1016/j.shpsa.2021.03.002.CrossRefGoogle ScholarPubMed
Callaway, Ewen. 2013. “Preprints Come to Life.” Nature 503 (7475):180.CrossRefGoogle ScholarPubMed
Cordner, Alissa,De La Rosa, Vanessa Y., Schaider, Laurel A, Rudel, Ruthann A, Richter, Lauren, and Brown, Phil 2019. “Guideline Levels for PFOA and PFOS in Drinking Water: The Role of Scientific Uncertainty, Risk Assessment Decisions, and Social Factors.” Journal of Exposure Science & Environmental Epidemiology 29 (2):157–71.CrossRefGoogle ScholarPubMed
de la Fuente, G. B. n.d. “What Is Open Science? An Introduction.” FOSTER, Accessed June 23, 2022. https://www.fosteropenscience.eu/content/what-open-science-introductionGoogle Scholar
Douglas, Heather. 2009. Science, Policy, and the Value-Free Ideal. Pittsburgh: University of Pittsburgh Press.CrossRefGoogle Scholar
Elliott, Kevin. 2017. A Tapestry of Values: An Introduction to Values in Science. New York: Oxford University Press.CrossRefGoogle Scholar
Elliott, Kevin. 2019. “Science Journalism, Value Judgments, and the Open Science Movement.” Frontiers in Communication 4:71. https://doi.org/10.3389/fcomm.2019.00071 CrossRefGoogle Scholar
Elliott, Kevin, and Resnik, David B.. 2019. “Making Open Science Work for Science and Society.” Environmental Health Perspectives 127:075002.CrossRefGoogle ScholarPubMed
Else, Holly. 2018. “Radical Open-Access Plan Could Spell End to Journal Subscriptions.” Nature 561 (7721):1718.CrossRefGoogle ScholarPubMed
Grimshaw, Jeremy, Eccles, Martin, Lavis, John, Hill, Sophie, and Squires, Janet. 2012. “Knowledge Translation of Research Findings.” Implementation Science 7: 50.CrossRefGoogle ScholarPubMed
Holloway, Tracey, Jacob, Daniel J. Daegan, Miller 2018. “Short History of NASA Applied Science Teams for Air Quality and Health.” Journal of Applied Remote Sensing 12 (4):042611 CrossRefGoogle Scholar
Hu, Xindi C., Andrews, David Q., Lindstrom, Andrew B., Bruton, Thomas A., Schaider, Laurel A., Grandjean, Philippe, Lohmann, Rainer, Carignan, Courtney C., Blum, Arlene, Balan, Simona A., Higgins, Christopher P., and Sunderl, Elsie M. 2016. “Detection of Poly- and Perfluoroalkyl Substances (PFASs) in US Drinking Water Linked to Industrial Sites, Military Fire Training Areas, and Wastewater Treatment Plants.” Environmental Science & Technology Letters 3 (10):344–50.CrossRefGoogle ScholarPubMed
Kupferschmidt, Kai. 2018. “A Recipe for Rigor.” Science 361 (6408):1192–3.CrossRefGoogle ScholarPubMed
Leonelli, Sabina. 2016. Data-Centric Biology: A Philosophical Study. Chicago: University of Chicago Press.CrossRefGoogle Scholar
Leonelli, Sabina, Spichtinger, Daniel, and Prainsack, Barbara. 2015. “Sticks and Carrots: Encouraging Open Science at its Source.” Geography and Environment 2 (1):1216.CrossRefGoogle ScholarPubMed
Levin, Nadine, and Leonelli, Sabina. 2017. “How Does One ‘Open’ Science? Questions of Value in Biological Research.” Science, Technology, & Human Values 42:280305.CrossRefGoogle ScholarPubMed
National Academies of Sciences, Engineering, and Medicine. 2018. Open Science by Design: Realizing a Vision for 21st Century Research. Washington, DC: National Academies Press.Google Scholar
National Academies of Sciences, Engineering, and Medicine. n.d. “Guidance on PFAS Testing and Health Outcomes.” Accessed June 23, 2022. https://www.nationalacademies.org/our-work/guidance-on-pfas-testing-and-health-outcomes.Google Scholar
Rivera, William M. 2011. “Public Sector Agricultural Extension System Reform and the Challenges Ahead.” Journal of Agricultural Education and Extension 17 (2):165–80.CrossRefGoogle Scholar
Ross-Hellauer, Tony, 2017. “What Is Open Peer Review? A Systematic Review.” F1000Research 6.Google ScholarPubMed
Royal Society. 2012. Science as an Open Enterprise. London: The Royal Society.Google Scholar
Schapira, Matthieu, and Harding, Rachel. 2019. “Open Lab Notebooks: Good for Science, Good for Society, Good for Scientists.” F1000Research 8:87.CrossRefGoogle ScholarPubMed
Silent Spring Institute. n.d. “Detox Me Action Kit.” Accessed June 23, 2022. https://wwww.silentspring.org/detoxmeactionkit/.Google Scholar
Silent Spring Institute. n.d. “PFAS-REACH.” Accessed June 23, 2022. https://silentspring.org/project/pfas-reach Google Scholar
Silent Spring Institute. n.d. “The PFAS Exchange.” Accessed June 23, 2022. https://pfas-exchange.org/ Google Scholar
Van De Gevel, Jeske, van Etten, Jacob, and Deterding, Sebastian. 2020. “Citizen Science Breathes New Life into Participatory Agricultural Research. A Review.” Agronomy for Sustainable Development 40:117.CrossRefGoogle Scholar
Wang, Sun Ling. 2014. “Cooperative Extension System: Trends and Economic Impacts on US Agriculture.” Choices 29 (1):18.Google Scholar