Hostname: page-component-76fb5796d-vfjqv Total loading time: 0 Render date: 2024-04-26T06:53:11.287Z Has data issue: false hasContentIssue false

Genetic testing and risk interpretation: How do women understand lifetime risk results?

Published online by Cambridge University Press:  01 January 2023

Yaniv Hanoch*
Affiliation:
University of Plymouth
Talya Miron-Shatz*
Affiliation:
Princeton University and Ono Academic College, Israel
Mary Himmelstein
Affiliation:
Princeton University
*
*Address: Yaniv Hanoch, University of Plymouth, School of Psychology, Drake Circus, Plymouth PL4 8AA, UK. Email: yaniv.hanoch@plymouth.ac.uk.
*Talya Miron-Shatz, Center for Health and Wellbeing, Princeton University, 327 Wallace Hall, Princeton, NJ. Email: tmiron@princeton.edu.
Rights & Permissions [Opens in a new window]

Abstract

Genetic screening for BRCA1 and BRCA2 gives women the opportunity for early detection, surveillance, and intervention. One key feature of genetic testing and counseling is the provision of personal lifetime risk. However, little attention has been paid to how women interpret lifetime risk information, despite the fact that they base screening, treatment and family planning decisions on such information. To study this vital issue, we set out to test the ability of women to choose the most appropriate interpretation of National Cancer Institute’s (NCI) message about lifetime risk of developing cancer for a woman with altered BRCA1 and BRCA2 genes. Participants included 277 women who had not undergone genetic testing or had cancer and 207 women who had undergone genetic testing or had cancer. Over 50% of the women who had not undergone genetic testing or had cancer and 40% of those who had undergone genetic testing or had cancer misunderstood NCI’s information. Furthermore, in line with a growing body of research, we found that high numeracy level (objective or subjective) is positively associated with a woman’s ability to correctly interpret NCI’s message.

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
The authors license this article under the terms of the Creative Commons Attribution 4.0 License.
Copyright
Copyright © The Authors [2010] This is an Open Access article, distributed under the terms of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.

1 Introduction

Genetic screening for BRCA1 and BRCA2 — gene mutations that are associated with higher risk of developing breast and ovarian cancers — gives women a shot at early detection, surveillance, and intervention (Heshka, Palleschi, Howley Wilson & Wells, Reference Heshka, Palleschi, Howley, Wilson and Wells2008). One key feature of the genetic counseling process is the provision of personal lifetime risk — or the risk of developing a specific disease during one’s lifetime (Armstrong, Eisen, & Weber, Reference Armstrong, Eisen and Weber2000). Indeed, both patients and genetic counselors rate communication of lifetime risk information as a pivotal part of the process (Lobb et al., Reference Lobb, Butow, Meiser, Barratt, Gaff and Young2003). This is not surprising, as women who test positive for BRCA1/2 often rely on lifetime risk estimates to make future family plans (e.g., having children; MacDonald, et al., Reference MacDonald, Choi, Sand, McCaffrey, Blazer and Grant2002) and to decide whether to undergo mastectomy despite being cancer free (Harmon, 2008).

Given the importance of lifetime risk information, researchers have been interested in whether women overestimate or underestimate their lifetime risk of developing cancer (Fagerlin, Zikmund-Fisher & Ubel, Reference Fagerlin, Zikmund-Fisher and Ubel2005; Heshka, Palleschi, Howley Wilson & Wells, Reference Heshka, Palleschi, Howley, Wilson and Wells2008; Katapodi, Lee, Faciona & Dodd, Reference Katapodi, Lee, Faciona and Dodd2004). Others have investigated the relationship between risk perception and emotional reaction, as well as between risk perception and mammography screening, and whether leaflets, genetic testing, and risk counseling improve women’s accuracy in estimating their lifetime risk of developing cancer (Hallowell, Statham & Murton, Reference Hallowell, Statham and Murton1998; Hopwood, Howell, Lallo & Evans, Reference Hopwood, Howell, Lalloo and Evans2003; Lipkus, Biradavolu, Fenn, Keller, & Rimer, Reference Lipkus, Biradavolu, Fenn, Keller and Rimer2001; Slaytor & Ward, Reference Slaytor and Ward1998; Vernon, Reference Vernon1999).

Although earlier studies examined women’s estimation of their lifetime risk, a more fundamental issue is how women interpret lifetime risk information. After all, if women misunderstand the meaning of lifetime risk, whether they overestimate or underestimate incorrectly interpreted risk would be less important. Indeed, research has shown that people interpret numerical probabilities in multiple, mutually contradictory ways. Researchers (Gigerenzer, Hertwig, Van den Broek, Fasolo & Katsikopoulos, Reference Gigerenzer, Hertwig, Van den Broek, Fasolo and Katsikopoulos2005; Murphy, Lichtenstein, Fischhoff & Winkler, Reference Murphy, Lichtenstein, Fischhoff and Winkler1980) have demonstrated that individuals interpret the seemingly unambiguous statement “There is a 30% chance of rain tomorrow” in different ways: “It will rain tomorrow in 30% of the region”, “for 30% of the time”, or “on 30% of the days like tomorrow” (Gigerenzer et al., Reference Gigerenzer, Hertwig, Van den Broek, Fasolo and Katsikopoulos2005 p. 625). Since people misconstrue common and mundane probabilistic information, interpreting probabilistic information like lifetime risk of developing cancer proves to be an even greater challenge, given the added emotional impact. To the authors’ knowledge, however, no previous studies have examined how women interpret statements regarding their lifetime risk of developing cancer or what variables (e.g., numeracy) might affect women’s ability to correctly interpret such information.

A growing corpus of research has shown that numeracy — the ability to understand basic mathematical concepts — is important to the quality of decisions (Peters et al., Reference Peters, Vastfjall, Slovic, Mertz, Mazzocco and Dickert2006). Accordingly, researchers have long argued that numeracy levels play a key role in a host of medical decision making and might influence the way people perceive and understand risk (Ancker & Kaufman, Reference Ancker and Kaufman2007; Lipkus, Samsa, & Rimer, Reference Lipkus, Biradavolu, Fenn, Keller and Rimer2001; Woloshin, Schwartz, Black & Welch, Reference Woloshin, Schwartz, Black and Welch1999). A recent review (Nelson, Reyna, Fagerlin, Lipkus & Peters, Reference Nelson, Reyna, Fagerlin, Lipkus and Peters2008; Reyna, Reference Reyna2001; Reyna & Brainerd, Reference Reyna and Brainerd2007) summarized this idea well: “Low numeracy is pervasive and constrains informed patient choice… impairs risk communication, and affects medical outcome” (Nelson et al., Reference Nelson, Reyna, Fagerlin, Lipkus and Peters2008: p. 261; emphasis added). While data strongly indicate the existence of a relationship between numeracy and medical decision making, whether numeracy levels affect women’s ability to interpret lifetime risk data is still an unanswered question.

In light of the abovementioned research and the gap in the existing literature, we set out to examine two related hypotheses. We first predicted that a statement about lifetime risk of developing cancer would give rise to various interpretations, not all of which would be correct. Second, we predicted that participants with higher numeracy levels will have a better understanding of lifetime risk information than their peers with lower numeracy levels.

2 Experiment 1

The goal of this study was to provide initial evidence for our hypotheses regarding the ability of women to accurately interpret the NCI statement about lifetime risk of developing cancer, examine the relationship between numeracy levels and understanding of lifetime risk information, and evaluate whether higher numeracy levels lead to more accurate risk estimation.

2.1 Methods

Participants. Participants included 277 women, who completed an online survey through advertisements on social networking websites. Participants responded to advertisements for filling out a short survey on health decisions in return for entry into a raffle for a $50 gift certificate to Amazon.com; all advertisements specifically targeted women over 18 years of age. An introductory page appeared before the survey, which provided information on the study, the participant’s right to withdraw without penalty, as well as information on the institution conducting the study. A small subsample (n = 14) of women had been previously tested for BRCA alterations or previously diagnosed with breast cancer. (See Study 2 below, however.) They were excluded from all analyses because of possible prior experience with BRCA screening (N after exclusion = 263). Participants were included in the analysis if they completed at least two questions in the survey; missing responses in the survey ranged from 0 to 24 (0–8.7% of sample). When the number of participants varies from the sample size (N = 263), n is indicated. The mean age of participants was 40.24 (SD = 13.75, n = 246). Additional demographic information can be found in Table 1.

Table 1: Genetic testing and lifetime risk

Procedure. Participants read the following information — taken directly from the official website of the National Cancer Institute (NCI, Unites States) — about lifetime risk of women with an altered BRCA1 or BRCA2 gene:

According to estimates of lifetime risk, about 13.2% (132 out of 1,000 individuals) of women in the general population will develop breast cancer, compared with estimates of 36 to 85% (360–850 out of 1000) of women with an altered BRCA1 or BRCA2 gene. In other words, women with an altered BRCA1 or BRCA2 gene are 3 to 7 times more likely to develop breast cancer than women with-out alterations in those genes (National Cancer Institute, 2002).

This statement was present on all pages that contained questions relating to risk interpretation, including most appropriate interpretation.

Most appropriate. After reading the above NCI statement, participants were asked to choose the most appropriate interpretation. Choices included (i) “Breast cancer will develop in 36 to 85% of women who are found to have BRCA1 and BRCA2 alterations” (the correct choice), (ii) “Breast cancer will develop in all women aged 36 to 85,” (iii) “Women who have BRCA1 and BRCA2 alterations will exhibit 36 to 85% of the symptoms associated with breast cancer,” and (iv) “Women who are found to have alterations in the genes called BRCA1 and BRCA2 have 36% to 85% higher chance of developing breast cancer.” We created the variable, “Most appropriate correct,” in which participants were coded as 1 (correct) for choosing the correct answer and 0 (incorrect) otherwise.

Numeracy. Participants completed a numeracy scale (α = 0.68) composed of 11 items (Lipkus, Samsa & Rimer, Reference Lipkus, Samsa and Rimer2001). Following the protocol of previous studies (Peters et al., Reference Peters, Vastfjall, Slovic, Mertz, Mazzocco and Dickert2006), we clustered participants into those with high numeracy levels versus those with low numeracy levels based on a median split on numeracy score. Participants who received a score of 9 or above were considered to possess high numeracy levels (n = 128); those with low numeracy levels received a score of 8 or less (n = 111). Participants in the high numeracy group were better educated than their low numeracy counterparts, t(237) = –3.15, p < .002. No difference existed between numeracy groups on age or income. This classification of high versus low numeracy level participants was only used in the context of one χ2 test comparing group distribution on most appropriate correct. For regression, we used continuous numeracy, which yielded similar results as the dichotomous numeracy variable.

2.2 Results

Most appropriate. Less than half the participants, 48.7% (n = 128), chose the correct interpretation (option 1 above). A similar proportion (45.6%, n = 120) believed that “Women who are found to have alterations in the genes called BRCA1 and BRCA2 have a 36% to 85% higher chance of developing breast cancer” was the right answer. An additional 4.2% (n = 11) chose “Women who have BRCA1 and BRCA2 alterations will exhibit 36 to 85% of the symptoms associated with breast cancer,” and 1.5% (n = 4) indicated that “Breast cancer will develop in all women ages 36 to 85” was the right answer. Thus, over 50% of our sample misrepresented the information provided by NCI.

A logistic regression on most appropriate correct by age, education, and continuous numeracy yielded several significant predictors. The chances of choosing the correct answer decreased as age increased (unstandardized B = –.02, SE = .10, p < .03). The likelihood of choosing the correct interpretation increased as education increased (B = .40 SE = .20, p < .04) and numeracy level increased (B = .22 SE = .06, p < .0001).

Numeracy. In line with earlier studies, we were interested in numeracy’s relationship with women’s ability to correctly interpret the NCI message, as well as with their risk perception. As predicted, numeracy level (continuous) significantly correlated positively with a ability to choose the correct interpretation of lifetime risk for breast cancer based on BRCA1/2 status, r(239) = .28, p < .01. The low numeracy group chose the correct interpretation about 35% of the time compared with the high numeracy participants, who chose the correct interpretation 64% of the time (Table 2).

Table 2: Differences in comprehension, in terms of most appropriate correct. χ2 tests are two tailed and uncorrected for continuity.

2.3 Discussion

Do women accurately interpret the NCI message regarding life time risk of developing breast cancer? Are women with high numeracy levels better able to interpret the NCI message? Study 1 provided initial evidence that women misinterpret the NCI lifetime risk message. Indeed, only half of the participants provided the correct answer. Our results also supported our prediction that numeracy levels would be associated with more accurate interpretation of the NCI message. Women who were classified as high numeracy were significantly more likely to provide the correct interpretation compared to women with low numeracy levels.

Despite our promising results, Study 1 has a number of limitations. First, it is unclear whether our results can be generalized to other populations. More specifically, as our sample contained only a limited number of women who had experienced genetic testing or had cancer, it is impossible for us to tell whether our results can be applied to women who have undergone or consider undergoing genetic testing or women who have had cancer. That is, women who are cancer-free and who have never considered genetic testing might be less likely to seek information about genetic testing and may have less motivation to fully engage in our study. Thus, it is important to examine how women who intend to undergo genetic testing, have already undergone genetic testing or have had cancer interpret the NCI message. It is feasible, after all, that this group of women would perform much better on our tasks as they have a clear interest in fully understanding their lifetime risk of developing cancer.

Finally, a number of authors (Fagerlin, Zikmund-Fisher, Ubel, Jankovic, Derry & Smith, Reference Fagerlin, Zikmund-Fisher, Ubel, Jankovic, Derry and Smith2007; Zikmund-Fisher, Smith, Ubel, & Fagerlin, Reference Zikmund-Fisher, Smith, Ubel and Fagerlin2007) have raised concerns over the usage of objective numeracy measures like the one used in Study 1. The authors argue that participants are not generally willing to undergo aptitude tests. More importantly, using objective measures of numeracy in internet-based studies is problematic, as researchers are unable to control participants’ reliance on others or calculators in solving the numeracy problems. These issues serve as the underlying motivation to develop the Subjective Numeracy Scale (SNS) (Fagerlin, et al., Reference Fagerlin, Zikmund-Fisher, Ubel, Jankovic, Derry and Smith2007; Zikmund-Fisher, et al., Reference Zikmund-Fisher, Smith, Ubel and Fagerlin2007). The SNC has the advantage of being quicker, more accessible and less likely to cause participants to seek external help. At the same time, it is as useful in measuring numeracy abilities as more objective measures (Zikmund-Fisher et al., Reference Zikmund-Fisher, Smith, Ubel and Fagerlin2007).

3 Experiment 2

To overcome two of the limitations in the first study, we amended our research in two important ways. Our second study involved women who had either undergone genetic testing or had cancer previously. With a more ecologically valid sample, we ensured that our participants possessed knowledge about and experience with genetic testing, thus eliminating the possibility that our initial results were due to ignorance about genetic testing. Our sample was likely more engaged as well, increasing the likelihood that any misconceptions stemmed from the nature of the NCI message rather than from participants’ lack of motivation. Furthermore, to address the concerns over usage of an objective numeracy scale (Lipkus et al., Reference Lipkus, Biradavolu, Fenn, Keller and Rimer2001) in an internet-based study, we decided to employ the newly developed subjective numeracy scale (Fagerlin et al., Reference Fagerlin, Zikmund-Fisher, Ubel, Jankovic, Derry and Smith2007; Zikmund-Fisher et al., Reference Zikmund-Fisher, Smith, Ubel and Fagerlin2007). By using the SNS, we were able to overcome concerns over participants’ reluctance to engage in problem-solving and reduced the likelihood that participants were seeking external aid (e.g., calculator or another person). Our aims, however, remained the same as in Study 1. We first predicted that a statement about lifetime risk of developing cancer would give rise to various interpretations, not all of which would be correct. Second, we predicted that participants with higher numeracy levels would have a better understanding of lifetime risk information than their peers with lower numeracy levels.

3.1 Method

Participants. Participants included 207 women who completed an online survey through advertisements on a breast cancer mailing list of approximately 5,000 subscribers. Participants responded to an email sent by the manager of the online mailing list for filling out a short survey on health decisions, in return for entry into a raffle for a $50 gift certificate to Amazon.com. An introductory page appeared before the survey, which provided information on the study, the participant’s right to withdraw without penalty, as well as information on the institution conducting the study. Most participants (n = 175, 84.5%) had either been screened for BRCA1 and BRCA 2 or had previously been diagnosed with breast cancer. Participants were included in the analysis if they completed at least two questions in the survey; missing responses in the survey ranged from 0 to 18 (0–8.7% of sample). When the number of participants varies from the sample size (n = 207), n is indicated. The mean age of participants was 43.13 (SD = 9.69, n = 189). Additional demographic information can be found in Table 1.

Procedure. The procedure was nearly identical to that found in the first study. The only notable difference involved numeracy, described below.

Numeracy. Participants completed the subjective numeracy scale: α = 0.89 (Fagerlin et al., Reference Fagerlin, Zikmund-Fisher, Ubel, Jankovic, Derry and Smith2007; Zikmund-Fisher et al., Reference Zikmund-Fisher, Smith, Ubel and Fagerlin2007), which consisted of 8 items. The scale is more user-friendly and roughly equivalent (r = 0.7) to the standard numeracy scale used in the study above (Zikmund-Fisher et al., Reference Zikmund-Fisher, Smith, Ubel and Fagerlin2007; Fagerlin et al., Reference Fagerlin, Zikmund-Fisher, Ubel, Jankovic, Derry and Smith2007). Participants rated their subjective ability with fractions, percentages, calculating tips, calculating discounts, and reading newspaper tables and graphs on a scale of 1 (not at all good) to 6 (extremely good). Two questions assessed preference for numeric or lexical presentation of mathematical data, rated on a scale of 1 (always prefer words) to 6 (always prefer numbers). The final question indicated how useful the participant find numeric information, on a scale of 1 (never useful) to 6 (always useful). The scale score represented the mean response to all 8 questions.

As in the previous study, we performed a median split to determine participants high in numeracy (mean subjective numeracy score greater than or equal to 4.625) versus those low in numeracy (mean subjective numeracy score less than 4.625). The low subjective numeracy group consisted of 92 participants who scored, on average, 3.61 on subjective numeracy (SD = 0.71). The high subjective numeracy group consisted of 115 participants who scored, on average, 5.27 (SD = 0.42). Participants who scored high in subjective numeracy (M = 9.18, SD = 2.43, n = 106) were in a higher income bracket than participants low in subjective numeracy (M = 8.22, SD = 2.73, n = 85): t(189) = –2.56, p < .01. No differences existed between numeracy groups on age or education.

Results

Most appropriate. Slightly more than half, 59.4% (n = 123), chose the correct interpretation (option 1 above). A similar proportion (40.1%, n = 83) believed that “Women who are found to have alterations in the genes called BRCA1 and BRCA2 have a 36% to 85% higher chance of developing breast cancer” was the right answer. An additional 0.5% (n = 1) chose “Women who have BRCA1 and BRCA2 alterations will exhibit 36 to 85% of the symptoms associated with breast cancer.” No one in the second sample believed all women with BRCA1 and BRCA2 would develop breast cancer. Still, over 40% of the sample misrepresented the information provided by the NCI.

A logistic regression on most appropriate correct by age, education, and subjective numeracy (continuous) yielded several significant predictors. The chances of choosing the correct answer decreased as age increased (B = –.03, SE = .16, p < .04). The likelihood of choosing the correct interpretation increased as education increased (B = .51 SE = .25, p < .01) and subjective numeracy increased (B = .56 SE = .17, p < .02).

Numeracy. In line with earlier studies, we were interested in numeracy’s relationship with a woman’s ability to correctly interpret the NCI message, as well as with her risk perception. As predicted, numeracy level (continuous) significantly correlated positively with a participant’s ability to choose the correct interpretation of lifetime risk for breast cancer based on BRCA1/2 status, r(207) = .29, p < .01. The low numeracy group chose the correct interpretation about 47% of the time compared with the high numeracy participants, who chose the correct interpretation 70% of the time (see Table 2).

3.1.1 Between-study comparison

Participants in Study 2 were slightly older (M = 43.13, SD = 40.68) than participants in experiment 1 (M = 40.68, SD = 13.63): t(447) = –2.11, p < .04. Participants in Study 2 (M = 8.75, SD = 2.61) also had slightly higher income than participants in experiment 1 (M = 7.19, SD = 3.30): t(449) = –5.42, p < .001. Participants in Study 2 (123 of 207 versus 134 of 277) were generally more likely to choose the correct interpretation of breast cancer risk: χ2 = 5.80, p < .02.

3.2 Discussion

In the second study, we aimed to replicate our findings from Study 1 with two notable differences: Testing a more ecologically valid sample and using a subjective numeracy scale rather than an objective one. Our results followed a similar pattern to the one found in the first experiment. Despite the fact that the majority of the sample in Study 2 (close to 85%) had undergone genetic testing, over 40% were unable to correctly identify the most appropriate answer. This result is still more worrisome than what we obtained in our first study, as it indicates that confusion persists even among women who have undergone BRCA 1/2 genetic testing and genetic counseling. Participants in Study 2, however, did perform better than those who participated in Study 1, possibly due to great experience with genetic testing. Also in line with Study 1, we found that subjective numeracy perceptions correlated positively with women’s ability to identify the correct interpretation of lifetime risk for breast cancer based on BRCA1/2 status. Thus, Study 2 complements and extends our findings from Study 1 in two important ways. First, it indicates that the ability to correctly interpret genetic testing results about lifetime risk of developing breast cancer is a challenging task regardless of whether one has relevant knowledge. Second, our data also provides support for the utility of using a subjective measure of numeracy.

4 General discussion

DNA technology has been developing rapidly, leading to an enhanced use of genetic testing in our understanding of disease diagnosis, treatment, and prevention. At the same time, there has been greater concern over people’s ability to understand and use lifetime risk information. Previous research has demonstrated, for example, that women often overestimate or underestimate their probability of developing cancer (Lipkus, Samsa & Rimer, Reference Lipkus, Samsa and Rimer2001). Yet, researchers have barely paid attention to exactly how women interpret lifetime risk information regarding cancer development.

Our results demonstrate that women — regardless of whether they have undergone BRCA1/2 genetic testing or not — translate lifetime risk information about the probability of developing breast cancer in multiple ways: examples include (a) the number of people of who will develop cancer, (b) the age range by which a woman will develop breast cancer, (c) the percentage of symptoms that a women is likely to experience, and (d) as a comparison to other women. The participants in our studies often chose the wrong interpretation.

Our data are more striking than the ones reported in previous studies (Gigerenzer, Hertwig, Van den Broek, Fasolo & Katsikopoulos, Reference Gigerenzer, Hertwig, Van den Broek, Fasolo and Katsikopoulos2005) for many reasons. First, the information provided by NCI and used in our experiment spelled out the reference class. That is, participants were clearly informed that 360–850 out of 1000 women with an altered BRCA1/2 gene are likely to develop breast cancer. Such presentation is associated with increased accuracy, in contrast with the traditional probabilistic presentation (Gigerenzer, Gaissmaier, Kurz-Milcke, Schwartz & Woloshin, Reference Gigerenzer, Gaissmaier, Kurz-Milcke, Schwartz and Woloshin2008). Second, the NCI information states that women with altered BRCA1/2 genes have 3–7 times the risk of developing breast cancer, not 36–85% higher risk as almost half of our sample believed. This is not minor misinterpretation, as having a 36–85% higher risk of developing breast cancer is equal to a lifetime risk of only 18–24.4%, which is 2–3.5 times lower than a lifetime risk of 36–85%. Third, even though women who had undergone genetic testing for BRCA 1/2 exhibited better performance, over 40% failed to identify the correct answer. Earlier studies (Butow, Lobb, Meiser, Barratt, & Tucker, Reference Butow, Lobb, Meiser, Barratt and Tucker2003; Meiser & Halliday, Reference Meiser and Halliday2002) have shown that risk perception improves after genetic counseling, which could help explain the improved results. However, the effects of improved risk perception seem relatively short-term (see Sivell, Elwyn, Gaff, Clarke, Iredale et al., Reference Sivell, Elwyn, Gaff, Clarke, Iredale, Shaw, Dundon, Thornton and Edwards2008). As we had no data regarding the time interval between undergoing genetic testing and participating in our research, it is possible that evaluating women directly after the genetic counseling session would yield better results. Finally, women’s false intuition about the correct answer is similar to the findings reported by Kahneman and Federick (Reference Kahneman, Frederick, Gilovich, Griffin and Kahneman2002) in other domains. In addition, both of our samples were more educated and wealthier than the general population, which raises even more concern over how a less educated and less affluent group would fare on our task. On the somewhat positive side, only 6% (and practically none among those who had undergone genetic testing) of our sample from study 1 believed that the NCI information indicated that all women between 36–85 years of age will develop breast cancer or that women with BRCA1/2 will experience 36–85% of the symptoms.

These results raise important questions about earlier research that focused on how accurately women estimate their lifetime risk. If women misinterpret the meaning of predicted lifetime risk, it is unclear what information they are actually estimating. For example, if women understand NCI’s information as indicating that all women between 36–85 years of age will develop breast cancer, do they over- or underestimate the age by which women would develop cancer? Do they attempt to estimate the percentage of symptoms that a woman will experience? Or do they estimate the likelihood that a woman with positive BRCA1/2 results will develop cancer? Unfortunately, we are unable to provide satisfactory answers.

Our data strongly demonstrate that objective numeracy levels play a crucial role in a woman’s ability to correctly identify the NCI’s intended message. Our results also reveal a similar pattern with regard to subjective numeracy levels, providing further support to using subjective numeracy measures rather than more objectives ones. Taken together, our data from the two studies are perfectly aligned with a growing body of evidence demonstrating the importance of numeracy in decision making in general, and medical decision making in particular (Gigerenzer, Gaissmaier, Kurz-Milcke, Schwartz & Woloshin, Reference Gigerenzer, Gaissmaier, Kurz-Milcke, Schwartz and Woloshin2008; Peters et al., Reference Peters, Vastfjall, Slovic, Mertz, Mazzocco and Dickert2006). Our study thus provides further support for the connection between numeracy level and accurate risk perception.

Our studies have a number of limitations. First, in Study 1 we surveyed a non-representative online sample and also asked them to think about a hypothetical person rather than themselves. Study 2, on the other hand, suffered from a low response rate. Thus, we are unable to tell whether those who participated in Study 2 are representative of the women who undergo genetic testing for BRCA 1/2. Since we have not evaluated general literacy levels and focused only on numeracy abilities, it is possible that general literacy levels are also associated with better ability to interpret the NCI message. A number of researchers (e.g., Brewer, Tzeng, Lillie, Edwards, Peppercorn, et al., Reference Brewer, Tzeng, Lillie, Edwards, Peppercorn and Rimer2009) have demonstrated that low health literacy is related to higher risk perception for developing breast cancer. Given the complexity of the NCI message and of the result from genetic testing, it is important that future studies evaluate both general literacy levels as well as numeracy abilities. Despite these limitations, our data are important for a number of reasons. In addition, despite earlier indications showing that including numeric risk information can increase trust and belief in the message (Gurmankin, Baron, & Armstrong, Reference Gurmankin, Baron and Armstrong2004), we did not pursue this important line of investigation. Our results, nonetheless, clearly demonstrate that women (regardless of whether they have undergone genetic testing) understand lifetime risk information in more than one way. We also highlight the importance of (objective and subjective) numeracy in understanding lifetime risk information.

This study focused on women and breast cancer, yet it is likely that similar results would emerge with males and with other medical conditions (e.g., coronary heart disease; e.g., Lloyd-Jones, Larson, Beiser, & Levy, Reference Lloyd-Jones, Larson, Beiser and Levy1999). Furthermore, we concentrated on lifetime risk information, given that academics, practitioners and national cancer organizations use this terminology. It is possible that using a one-year or a five-year risk estimate would yield similar results. Further research should examine whether the obstacle to correct interpretation lies with the concept of lifetime risk itself, or from the fact that lifetime risk is presented as a range. As genetic testing becomes more widespread and available options increase, it is important to ensure that patients correctly interpret the lifetime risk information yielded by these tests and do not act upon misconstrued lifetime risk assessments.

Footnotes

*

Yaniv Hanoch and Talya Miron-Shatz contributed equally to the preparation of the article. The authors would like to Alice Muelhof, an anonymous reviewer, Jonathan Baron and Peter Ubel for comments on earlier drafts. The study was supported by the Center for Health and Wellbeing, Princeton University and by an NIA pilot grant # 400–6223 and by NIH Grant P30 AG024361.

References

Ancker, J. S., & Kaufman, D. (2007). Rethinking health numeracy: A multidisciplinary literature review. Journal of the American Medical Informatics Association, 14, 713721.CrossRefGoogle ScholarPubMed
Armstrong, K., Eisen, A., & Weber, B. (2000). Assessing the risk of breast cancer. New England Journal of Medicine, 342, 564–471.CrossRefGoogle ScholarPubMed
Brewer, N. T., Tzeng, J. P., Lillie, S. E., Edwards, A. S., Peppercorn, J. M., & Rimer, B. K. (2009). Health literacy and cancer risk perception: Implications for genomic risk communication. Medical Decision Making, 9, 5766.Google Scholar
Butow, P. N., Lobb, E. A., Meiser, B., Barratt, A. & Tucker, K. M. (2003). Psychological outcomes and risk perception after genetic testing and counselling in breast cancer: A systematic review. Medical Journal of Australia, 178, 7781.CrossRefGoogle ScholarPubMed
Fagerlin, A., Zikmund-Fisher, B. J., & Ubel, P. A. (2005). How making risk estimate can change the feel of that risk: Shifting attitudes toward breast cancer risk in a general public survey. Patient Education and Counseling, 57, 294299.CrossRefGoogle Scholar
Fagerlin, A., Zikmund-Fisher, B. J., Ubel, P. A., Jankovic, Al., Derry, H. A., & Smith, D. M. (2007). Measuring numeracy without a math test: Development of the subjective numeracy scale. Medical Decision Making, 27, 672680.CrossRefGoogle ScholarPubMed
Gigerenzer, G., Gaissmaier, W., Kurz-Milcke, E., Schwartz, L. M., & Woloshin, S. (2008). Helping doctors and patients make sense of health statistics. Psychological Science in the Public Interest, 8, 5396.CrossRefGoogle Scholar
Gigerenzer, G., Hertwig, R., Van den Broek, E., Fasolo, B., & Katsikopoulos, K. V. (2005). A 30% chance of rain tomorrow: How does the public understand probabilistic weather forecasts? Risk Analysis, 25, 623629.CrossRefGoogle ScholarPubMed
Gurmankin, A. D., Baron, J., & Armstrong, K. (2004). The effect of numerical statements of risk on trust and comfort with hypothetical physician risk communication. Medical Decision Making, 24, 265271.CrossRefGoogle ScholarPubMed
Hallowell, N., Statham, H., & Murton, F. (1998). Women’s understanding of their risk of developing breast/ovarian cancer before and after genetic counseling. Journal of Genetic Counseling, 7, 345364.CrossRefGoogle ScholarPubMed
Harmon, A. (2007, Sept 16). Cancer free at 33, but weighing a mastectomy. New York Times. Retrieved October 10, 2008, from http://www.nytimes.com/2007/09/16/health/16gene.html?_r=1&scp=1&sq=cancer+free+at+33&st=nyt3Google Scholar
Heshka, J. T., Palleschi, C., Howley, H., Wilson, B., & Wells, P. S. (2008). A systematic review of perceived risks, psychological and behavioral impacts of genetic testing. Genetics in Medicine, 10, 1932.CrossRefGoogle ScholarPubMed
Hopwood, P., Howell, A., Lalloo, F., & Evans, G. (2003). Do women understand the odds? Risk perceptions and recall of risk information in women with family history of breast cancer. Community Genetics, 6, 214223.Google ScholarPubMed
Kahneman, D. & Frederick, S. (2002). Representativeness revisited: Attribute substitution in intuitive judgment. In Gilovich, T. Griffin, D. & Kahneman, D. (Eds.), Heuristics of Intuitive Judgment: Extensions and Applications (pp. 4881). New York: Cambridge University PressGoogle Scholar
Katapodi, M. C., Lee, K. A., Faciona, N. C., & Dodd, M. J. (2004). Predictors of perceived breast cancer risk and the relation between perceived risk and breast cancer screening: A meta-analytic review. Preventive Medicine, 38, 388402.CrossRefGoogle ScholarPubMed
Lipkus, I. M., Biradavolu, M., Fenn, K., Keller, P., & Rimer, B. K. (2001). Informing women about their breast cancer risks: Truth and consequences. Health Communication, 13, 205229.CrossRefGoogle ScholarPubMed
Lipkus, I. M., Samsa, G., & Rimer, B. K. (2001) General performance on a numeracy scale among highly educated samples. Medical Decision Making, 21, 3744.CrossRefGoogle ScholarPubMed
Lobb, E. A., Butow, P. N., Meiser, B., Barratt, A., Gaff, C., Young, M., et al. (2003). Women’s preference and consultants’ communication of risk in consultations about familial breast cancer: Impact and patient outcome. Journal of Medical Genetics, 40, 18.CrossRefGoogle Scholar
Lloyd-Jones, D. M., Larson, M. G., Beiser, A. & Levy, D. (1999). Lifetime risk of developing coronary heart disease. Lancet, 353, 8992.CrossRefGoogle ScholarPubMed
MacDonald, D. J., Choi, J., Sand, S., McCaffrey, S., Blazer, K. R., Grant, M., et al. (2002). Concerns of women presenting to a comprehensive cancer centre for genetic cancer risk assessment. Journal of Medical Genetics, 39, 526530.CrossRefGoogle ScholarPubMed
Meiser, B., & Halliday, J. L. (2002). What is the impact of genetic counseling in women at increased risk of developing hereditary breast cancer? Social Science & Medicine, 54, 14621470.CrossRefGoogle ScholarPubMed
Murphy, A. H., Lichtenstein, S., Fischhoff, B., & Winkler, R. L. (1980). Misinterpretation of precipitation probability forecasts. Bulletin of the American Meteorological Society, 61, 695701.2.0.CO;2>CrossRefGoogle Scholar
National Cancer Institute. (2002, February). National cancer institute fact sheet, genetic testing for BRCA1 and BRCA2: It’s your choice. Retrieved April 10, 2009, from the National Cancer Institute Web Site: http://www.cancer.gov/cancertopics/factsheet/risk/brca.Google Scholar
Nelson, W., Reyna, V. F., Fagerlin, A., Lipkus, I., & Peters, E. (2008). Clinical implications of numeracy: Theory and practice. Annals of behavioral medicine, 35, 261274.CrossRefGoogle ScholarPubMed
Peters, E., Vastfjall, D., Slovic, P., Mertz, C. K., Mazzocco, K., & Dickert, S. (2006). Numeracy and decision making. Psychological Science, 17, 407413.CrossRefGoogle ScholarPubMed
Reyna, V. F. (2001). Genetic testing and medical decision making. Archives of Internal Medicine, 161, 24062408.CrossRefGoogle ScholarPubMed
Reyna, V. F., & Brainerd, C. J. (2007). The importance of mathematics in health and human judgment: Numeracy, risk communication, and medical decision making. Learning and Individual Differences, 17, 147159.CrossRefGoogle Scholar
Sivell, S., Elwyn, E., Gaff, C. L., Clarke, A. J., Iredale, R., Shaw, C., Dundon, J., Thornton, H., & Edwards, A. (2008). How risk is perceived, constructed and interpreted by clients in clinical genetics, and the effects on decision making: Systematic review. Journal of Genetic Counseling, 17, 3063.CrossRefGoogle ScholarPubMed
Slaytor, E. K., & Ward, J. E. (1998). How risk of breast cancer and benefits of screening are communicated to women: Analysis of 58 pamphlets. British Medical Journal, 317, 263264.CrossRefGoogle ScholarPubMed
Vernon, S. W. (1999). Risk perception and risk communication for cancer screening behaviors: A review. Journal of the National Cancer Institute Monographs, 25, 101119.CrossRefGoogle Scholar
Woloshin, S., Schwartz, L., Black, W. C., & Welch, H. (1999). Women’s perception of breast cancer risk: How you ask matters. Medical Decision Making, 19, 221229.CrossRefGoogle ScholarPubMed
Zikmund-Fisher, B. J., Smith, D. M., Ubel, P.A., & Fagerlin, A. (2007). Validation of the subjective numeracy scale: Effects of low numeracy on comprehension of risk communications and utility elicitations. Medical Decision Making, 27: 663671.CrossRefGoogle ScholarPubMed
Figure 0

Table 1: Genetic testing and lifetime risk

Figure 1

Table 2: Differences in comprehension, in terms of most appropriate correct. χ2 tests are two tailed and uncorrected for continuity.