Hostname: page-component-76fb5796d-r6qrq Total loading time: 0 Render date: 2024-04-26T21:38:58.278Z Has data issue: false hasContentIssue false

What factors empower general practitioners for early cancer diagnosis? A 20-country European Delphi Study

Published online by Cambridge University Press:  25 November 2022

George Tzanis
Affiliation:
Laboratory of Primary Health Care, General Practice and Health Services Research, Aristotle University of Thessaloniki, Thessaloniki, Greece
Michael Harris
Affiliation:
College of Medicine & Health, University of Exeter, Exeter, UK Institute of Primary Health Care Bern (BIHAM), University of Bern, Bern, Switzerland
Mette Brekke
Affiliation:
General Practice Research Unit, University of Oslo, Oslo, Norway
Mercè Marzo-Castillejo
Affiliation:
Cancer Research Group in Primary Health Care, Fundació Institut Universitari per a la Recerca a l’Atenció Primària de Salut Jordi Gol i Gurina (IDIAPJGol), Barcelona, Spain Unitat de Suport a la Recerca Metropolitana Sud, Direcció d’Atenció Primària Costa de Ponent, ICS, Barcelona, Spain
Saliha Serap Cifcili
Affiliation:
Family Medicine Department, School of Medicine, Marmara University, Istanbul, Turkey
Wojciech Wawrzynek
Affiliation:
The Medical Centre, Roscommon, Ireland
Maria Flamm
Affiliation:
Paracelsus Medical University; Institute of General Practice, Salzburg, Austria Family Medicine and Preventive Medicine, Center for Public Health and Healthcare Research, Salzburg, Austria
Nicola Buono
Affiliation:
National Society of Medical Education in General Practice (SNAMID), Caserta, Italy
Bernadett Márkus
Affiliation:
Department of Family Medicine, Semmelweis University, Budapest, Hungary
Galia Zacay
Affiliation:
Department of family medicine, Sackler Faculty of Medicine, University of Tel Aviv, Tel Aviv, Israel Department of family medicine, Meuhedet Health Maintenance Organization, Israel
Ilze Skuja
Affiliation:
Department of Family Medicine, Riga Stradins University, Riga, Latvia
Zlata Ozvacic Adzic
Affiliation:
School of Medicine, Department of Family Medicine, University of Zagreb, Zagreb, Croatia Zagreb-Centar Health Center, Zagreb, Croatia
Mihai Iacob
Affiliation:
EUVEKUS, Timis Society of Family Medicine, Timisoara, Romania
Radost Asenova
Affiliation:
Department of Urology and General Practice, Faculty of Medicine, Medical University of Plovdiv, Plovdiv, Bulgaria
Davorina Petek
Affiliation:
Department of Family medicine, Faculty of Medicine, University of Ljubljana, Ljubljana, Slovenia
Krzysztof Buczkowski
Affiliation:
Department of Family Medicine, Nicolaus Copernicus University, Torun, Poland
Pamela Curtis
Affiliation:
Close Farm Surgery, UK
Liina Pilv-Toom
Affiliation:
Institute of Family Medicine and Public Health, University of Tartu, Tartu, Estonia
Robert Hoffman
Affiliation:
Department of family medicine, Sackler Faculty of Medicine, University of Tel Aviv, Tel Aviv, Israel
Emmanouil Smyrnakis*
Affiliation:
Laboratory of Primary Health Care, General Practice and Health Services Research, Aristotle University of Thessaloniki, Thessaloniki, Greece
*
Author for correspondence: Emmanouil Smyrnakis, Associate Professor in Primary Health Care – Medical Education, Laboratory of Primary Health Care, General Practice and Health Services Research – Medical School, Aristotle University of Thessaloniki, Greece. Tel.: 0030 2310 999147, fax: 0030 2310 999131. E-mails: smyrnak@auth.gr; smyrnak@gmail.com
Rights & Permissions [Opens in a new window]

Abstract

Background:

Some symptoms are recognised as red flags for cancer, causing the General Practitioner (GP) to refer the patient for investigation without delay. However, many early symptoms of cancer are vague and unspecific, and in these cases, a delay in referral risks a diagnosis of cancer that is too late. Empowering GPs in their management of patients that may have cancer is likely to lead to more timely cancer diagnoses.

Aim:

To identify the factors that affect European GPs’ empowerment in making an early diagnosis of cancer.

Methods:

This was a Delphi study involving GPs in 20 European countries. We presented GPs with 52 statements representing factors that could empower GPs to increase the number of early cancer diagnoses. Over three Delphi rounds, we asked GPs to indicate the clinical relevance of each statement on a Likert scale.

The final list of statements indicated those that were considered by consensus to be the most relevant.

Results:

In total, 53 GPs from 20 European countries completed the Delphi process, out of the 68 GPs who completed round one. Twelve statements satisfied the pre-defined criteria for relevance. Five of the statements related to screening and four to the primary/secondary care interface. The other selected statements concerned information technology (IT) and GPs’ working conditions. Statements relating to training, skills and working efficiency were not considered priority areas.

Conclusion:

GPs consider that system factors relating to screening, the primary-secondary care interface, IT and their working conditions are key to enhancing their empowerment in patients that could have cancer. These findings provide the basis for seeking actions and policies that will support GPs in their efforts to achieve timely cancer diagnosis.

Type
Research
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2022. Published by Cambridge University Press

Background

Every day, patients present to their General Practitioners (GPs) with symptoms which could be due to cancer (Hamilton, Reference Hamilton2009). Some symptoms are recognised as red flags for cancer, resulting in the GP referring the patient for further diagnostic tests without delay. However, many early symptoms of cancer are vague and unspecific, and are similar to those of benign or self-limiting conditions (Foot and Harrison, Reference Foot and Harrison2011). The GP faces a difficult balancing act between investigating more patients, which puts a strain on healthcare resources, and investigating less, so risking a delayed diagnosis of cancer (Nicholson, et al., Reference Nicholson, Mant and Bankhead2016). Several factors may influence GPs’ actions, including medical competence, workload and system factors like access to investigations and referral pathways (Harris, et al., Reference Harris and Taylor2018; Harris, et al., Reference Harris, Brekke, Dinant, Esteva, Hoffman, Marzo-Castillejo, Murchie, Neves, Smyrnakis, Vedsted, Aubin-Auger, Azuri, Buczkowski, Buono, Foreva, Babić, Jacob, Koskela, Petek, Šter, Puia, Sawicka-Powierza, Streit, Thulesius, Weltermann and Taylor2019), mirroring different levels of GPs’ empowerment.

Empowerment has been defined as ‘the process of gaining freedom and power to do what you want or to control what happens to you’ (Cambridge Dictionary, 2021). Roller describes empowerment as a product of three dimensions: autonomy (peoples’ perception of the level of freedom and personal control in the performance of their job), participation (the degree to which they feel they contribute to their organisation’s administrative or strategic decisions) and responsibility (the level of concern, care and commitment that they bring to a task or position) (Roller, Reference Roller1998). One aspect of empowerment is structural empowerment, which can be described as the structures within an organisation that empower clinicians, for example, to practice in a professional and autonomous manner and achieve clinical excellence and professional fulfilment. According to Kanter, power is defined as the ‘ability to mobilise resources to get things done’ (Kanter, Reference Kanter1993). Kanter believes that access to four ‘sources’ or ‘lines’, namely information, support, resources and opportunities to learn and grow, are key determinants of empowerment within an organisation. It has been demonstrated that there is a link between empowering work settings and outcomes like job satisfaction, organisational commitment and effectiveness (Orgambídez-Ramos and Borrego-Alés, Reference Orgambídez-Ramos and Borrego-Alés2014). Empowerment is seen as being critical to clinicians’ ability to effect change in the healthcare system and society (Falk-Rafael AR, Reference Falk-Rafael, Chinn, Anderson, Laschinger and Rubotzky2004).

There are few studies in relation to what empowers doctors (Verbeten, Reference Verbeten2007; Mesko and Győrffy, Reference Mesko and Győrffy2019; Yakes et al., Reference Yakes, Dean, Labadie, Byrne, Estrada, Thompson, Kendall and Yarbrough2020). Those studies have focused on the shifting power from healthcare providers towards employers, and how managed care regulation affects providers (Brown and Eagan, Reference Brown and Eagan2004). Lately, the effect of the challenges and demands of digital health care on doctors’ empowerment have attracted interest (Mesko and Győrffy, Reference Mesko and Győrffy2019). The increasing interest in doctors’ health and well-being indicates the need to consider their perspectives on what empowers them in terms of job satisfaction. (Yakes et al., Reference Yakes, Dean, Labadie, Byrne, Estrada, Thompson, Kendall and Yarbrough2020). Most studies on empowerment in healthcare settings have focused on the nursing profession (Irvine et al., Reference Irvine, Leatt, Evans and Baker1999; Fullam et al., Reference Fullam, Lando, Johansen and Reyes1998; Wong and Laschinger, Reference Wong and Laschinger2013; Orgambídez-Ramos and Borrego-Alés, Reference Orgambídez-Ramos and Borrego-Alés2014; Trus et al., Reference Trus, Galdikiene, Balciunas, Green, Helminen and Suominen2019). One study showed that the more nurses perceive they have access to workplace empowerment structures, the more they feel satisfied with their work and report higher performance (Wong and Laschinger, Reference Wong and Laschinger2013).

Doctors who are empowered in their care of patients are less likely to face obstacles in the diagnostic pathway and more likely to be enabled to make timely diagnoses. This study therefore aims to identify factors that European GPs feel empower them to make a timely diagnosis in patients with symptoms which could be due to cancer.

Methodology

This multicentre study used the Delphi technique, as this method allows us to collect and achieve consensus on panellists’ opinions. It is a structured communication process, where a panel of experts answers questions to which there are no scientifically proven correct answers (Linstone et al., Reference Linstone, Turoff and Helmer1975; Linstone, Reference Linstone1985; Boulkedid et al., Reference Boulkedid, Abdoul, Loustau, Sibony and Alberti2011). It enables anonymous systematic refinement of expert opinions, with the aim of arriving at a combined or consensus position. The assumption is that the judgement of a group of experts, the ‘Delphi panellists’, will be more valid than individual judgements. Consensus is reached through consecutive rounds in which panellists are invited to modify their answers as a result of seeing the responses made by the panel in previous rounds.

Our study was organised through the Örenäs Research Group (ÖRG), a group of primary care researchers in 30 European countries that studies the primary care factors that relate to cancer survival. A core project group of eight members planned the study.

Outcome measure

The primary outcome was the identification of empowerment factor statements with the most agreement among GP panellists that they were clinically relevant in a primary care setting.

Generation of the statements

During the preliminary phase, the core project group members each wrote a list of factors that they believed affect GPs’ empowerment in making an early cancer diagnosis. The resulting 97 factors were collated and put in alphabetical order in the form of 77 statements. Each statement started with the following phrase:

‘GPs would be empowered to increase the number of early cancer diagnoses by…’.

In a pilot round, all other ÖRG members (n = 76) were invited to study the list of statements and suggest additions. Proposed additions were reviewed by the core project group. For each statement, ÖRG members were asked to evaluate its clinical relevance in a primary care setting, using a Likert scale ranging from 1 (no clinical relevance) to 9 (highly clinically relevant), to comment on the statements, and suggest any statements that they thought were missing. We received responses from 40 ÖRG members in 23 European countries. Respondents made 121 comments and suggestions: where these suggested that any statements were ambiguous or unclear, we changed the wording of the statements. No new statements arose as a result of this process.

The core project group had decided that the number of statements included in the final list should be around 50, to achieve a balance between having enough statements and maintaining panellists’ interest throughout the Delphi study.

After analysing the results and omitting the statements with the lowest Likert scores, we produced a final list of 52 statements. The project coordinators grouped these statements according to their content. The number and names of the groups, and the distribution of the statements in the groups, were discussed and agreed upon by the core project group. For example, all the statements related to cancer screening were placed in one group, whereas those related to tests for cancer formed another group. The resulting 14 groups of statements are given in Appendix 1.

Recruitment

All ÖRG members were sent a copy of the study protocol and invited to recruit panellists in their countries (as ‘Local Leads’). Where there was more than one member in a country, they were asked to agree who would be the Local Lead. The project coordinators produced a model invitation email for possible panellists that each Local Lead could adapt according to their needs. Local Leads were asked to approach seven potential Delphi panellists and ask for consent to give their names and email addresses to the project coordinators.

The project coordinators then contacted these potential Delphi panellists by email (five for each country, with two in reserve) with information about the study, a Participant Information Sheet, an invitation to join the study and a link to the survey if they decided to take part. Possible panellists from the reserve lists were invited only if we did not receive five responses from that country.

The recruitment criteria that the Local Leads were asked to use to select the Delphi panellists are shown in Table 1.

Table 1. The Delphi panellists’ recruitment criteria

Delphi rounds

The Delphi process consisted of 3 rounds:

  • Round 1. Panellists were presented with the list of statements, which were organised in five randomly ordered survey pages. For each statement, the panellists were asked to score the statements on a Likert scale from 1 (no clinical relevance in a primary care setting) to 9 (highly clinically relevant). Panellists who had not replied or completed the survey were sent two reminders. The core project group calculated mean scores with their standard deviations (SDs) for each statement.

  • Round 2. Panellists were shown the list of statements in descending order of the first round’s mean Likert scores, accompanied by their SDs, and were asked to consider these while completing the Likert scales again. After two reminders to non-responders, the project coordinators once more calculated mean scores and SDs for each statement.

  • Round 3. Panellists were shown the list of statements in descending order of the second round’s mean Likert scores, accompanied by their corresponding SDs. They were asked to consider these while completing the Likert scales for a final time. The Delphi data collection ended after we had sent two reminders to non-responders.

Data collection

The data were collected with a web-based survey platform (SurveyMonkey Inc.). Survey links were provided by the project coordinators. The survey language was English.

The first survey page described the aim of the study, the role of the Örenäs Research Group and the process of the Delphi study. A web link led to further details, including information about data protection. There was a statement that participation was entirely voluntary and that the panellists could withdraw at any time.

The second page asked for demographic details: country, whether worked as a GP in the last two years, whether working as a GP academic, sex, years of working experience since graduation and working area (rural, urban or mixed).

Next, five survey pages presented the 52 statements. Each page presented three statement groups (except for one page with only two statement groups). To reduce the risk of order-effects bias (Israel and Taylor, Reference Israel and Taylor1990), we constructed five versions of the survey, each with a different URL and a different order of the five statement pages. Within the statement groups, the statements were presented in alphabetical order. In each country, every panellist received a different URL link.

Statistical analysis

The demographic characteristics of the respondents were explored using descriptive statistics.

For each statement, the degree of consensus was based on the mean Likert score and the corresponding standard deviation (SD), as a lower SD indicates increased concordance between panellists’ responses. To select statements with substantial consensus, we pre-defined the threshold for inclusion in the final list of statements as the mean Likert score minus one SD ≥ 5 (after Nyborg et al., Reference Nyborg, Straand, Klovning and Brekke2015).

Figure 1 summarises the process of the study.

Figure 1. The Delphi study process.

Results

The Delphi study began in May 2020, and the process lasted four months. Figure 2 shows the number of GPs initially invited and the number of panellists for each of the three Delphi rounds.

Figure 2. The number of GPs initially invited and the number of panellists for each of the Delphi rounds.

Delphi round response rates

In total, 105 GPs from 21 European countries, 5 panellists per country, were identified by their Local Leads and invited to participate. We invited 17 more GPs from the reserve lists of the countries with the lowest response rates. After two reminders, 71 GPs from 20 countries had completed the first round of the survey, 49 had not responded, and 2 had refused to participate. We excluded 3 responders because they did not meet the eligibility criteria. This meant that 68 eligible GPs completed Round 1 of the Delphi study and were invited to participate in Round 2.

Of those, 56 (82.3%) completed Round 2 and were invited to take part in Round 3.

In Round 3, 53 panellists (77.9% of those who had completed Round 1) completed the questionnaire.

The numbers of GPs involved, by country, at different stages of the process are presented in Appendix 2.

Table 2 shows the demographic data of the eligible GPs who completed Round 1.

Table 2. Demographic data of the 68 panellists who completed Round 1

Likert scale scores

Table 3 compares the mean Likert scale score SDs for all the statements combined across the three Delphi rounds, demonstrating an increase in the degree of consensus over the course of the rounds.

Table 3. Mean standard deviation (SD) of Likert scale scores for all the statements in the three Delphi rounds

Twelve of the 52 statements satisfied the pre-defined selection criterion for how GPs believe they would be empowered to increase the number of early cancer diagnoses. These fell into four groups as presented in Table 4. All the 52 statements and their Round 3 scores, presented in descending order of their ‘mean statement score – SD’ value, are given in Appendix 3.

Table 4. The 12 statements satisfying the pre-defined Delphi selection criterion

Discussion

Principal findings

In total, 53 panellists from 20 different countries across Europe completed the three rounds of the Delphi process. Twelve statements satisfied the pre-defined selection criterion for how GPs believe that they would be empowered when diagnosing patients who may have cancer. Five of the statements related to screening, and four to the patient and GP interface with secondary care. The other selected statements concerned IT and GPs’ working conditions. Statements relating to training, skills and working efficiency were not considered priority areas.

Strengths and weaknesses

The Delphi statements were carefully developed and piloted by researchers from 23 European countries, most of whom were GPs, and therefore, the study was grounded in their clinical experience. The study had a broad spectrum of participating centres, with countries from each of the Central, Eastern, Northern, Southern and Western European geographical areas, providing variation in geography, socioeconomic and health systems, gate-keeping and referral systems, and levels of healthcare spending.

Although we did not aim to reach a representative sample of GPs in this study, most panellists were from the Local Leads’ own localities and over half of panellists were academic GPs, which may have led to sampling bias. The recruitment method used in this study resulted in variable response rates, leading to a risk of non-response bias. However, 53 GPs completed the Delphi process, 78% of those that had started it. While the findings are a consensus of GPs from 20 different European countries, some statements will have more relevance in some countries than others. While we defined a cut-off level for statement inclusion based on previous studies (Nyborg et al., Reference Nyborg, Straand, Klovning and Brekke2015) before we started to collect data, this choice of level was empirical.

The use of the Delphi methodology has some limitations in itself. There are no agreed standards on how to select the participants or how to interpret and analyse the results, and there are no universally agreed definitions of consensus (Fink-Hafner et al., Reference Fink-Hafner, Dagen, Dousak, Novak and Hafner-Fink2019). Methodological limitations include the difficulty of generalising the results to a wider population due to the sample size, limited views, the uneven spread of expertise among the panellists and panellists’ specific agendas. While the method encourages panellists to reconsider their views at each round in response to additional information, this flexibility can introduce bias, with participants altering their response to comply with what they view to be the majority opinion (Barrett, Reference Barrett2020).

Comparison with existing literature

In line with our findings, Curry et al. (2003) have shown that factors related to cancer screening, as well as workload and links between primary and secondary care, are considered essential for enhancing doctors’ practice. In countries where cancer screening is not routinely available, our panellists think that this should be implemented, in order to empower them to make timely cancer diagnoses. Efforts to construct more reliable systems for cancer screening, an issue prioritised by our panellists, as well as incorporation of new knowledge into screening programmes and development of new technologies for cancer screening, are important for early cancer diagnosis (Loud and Murphy, Reference Loud and Murphy2017). While population-wide screening programmes for breast, cervical and colorectal cancers are active in a majority of European countries, these programmes typically function independently of primary care, ignoring opportunities for primary care to enhance the effectiveness of the programmes by promoting uptake, information provision and informed choice (Weller et al., Reference Weller, Patnick, McIntosh and Dietrich2009). Evidence-based screening programmes support GPs’ empowerment by enabling them to avoid harms due to low-value or outdated screening programmes, and by conforming with populations’ interests (Parker et al., Reference Parker, Carter, Williams, Pickles and Barratt2017). Our study found that motivating GPs to take part in screening is considered an essential factor for empowerment. The most important motivating factors have been found to be the following: GP involvement in the planning of the screening programmes, receiving regular feedback on patients’ screening results, taking part in training courses, having a lower workload, and having financial incentives (Launoy et al., Reference Launoy, Veret, Richir, Reaud, Ollivier, Valla and Gignoux1993).

Our study indicated that having quicker and easier communication, shorter waiting times and getting prompt advice from secondary care are essential. Close links between primary and secondary health care are necessary for good quality patient care (Dinsdale et al., Reference Dinsdale, Hannigan, O'Connor, O'Doherty, Glynn, Casey, Hayes, Kelly, Cullen and O'Regan2020), since improved communication is associated with better health, better prevention, fewer hospital admissions and increased patient satisfaction; it also minimises treatment delays, additional workload, higher costs and reduced patient safety (Dinsdale et al., 2020). GPs develop a sense of belonging and participation when establishing meaningful working relationships and having improved connectedness with specialists for their clinical work, which is essential for their clinical empowerment (Fulton et al., Reference Fulton, Williams, Shah, Phillips, Fluxman and Hoare2016; Carrieri et al., Reference Carrieri, Pearson, Mattick, Papoutsi, Briscoe, Wong and Jackson2020). GPs’ early suspicion of cancer has been shown to improve outcomes if it reduces the time to diagnosis and treatment (Probst et al., Reference Probst, Hussain and Andersen2012). This supports our panel’s views that timely access to laboratory tests and other diagnostic processes, and use of rapid access pathways, empowers GPs in this field.

Our panel felt that better IT to support communication and information transfer is important: the exploitation of IT has been found to provide savings in time and effort, and, generally, a good experience with patients who nowadays are active in their care and use digital technologies in their health management (Mesko and Győrffy, Reference Mesko and Győrffy2019). Risk assessment tools and electronic reminders are also considered essential for assisting doctors’ efforts for early cancer diagnosis (Gomy and Diz, Reference Gomy and Diz2013; Printz, Reference Printz2020).

Concerns about workload and bureaucracy, two areas that were prioritised by our panellists, have attracted attention to doctors’ working conditions, especially in relation to their health and risk of burnout (Scheepers et al., Reference Scheepers2020). A high level of bureaucracy takes GPs away from direct patient care (Schäfer, Berg and van der Groenewegen, Reference Schäfer, van den Berg and Groenewegen2020). Establishing a good balance between quantity and quality of time at work improves both quality of care and GPs’ job satisfaction (British Medical Association, 2020).

Implications for research and practice

These study findings provide the basis for seeking actions and policies that will support GPs in their efforts in the timely diagnosis of cancer. European countries need establish reliable screening systems for cancer, where these do not already exist. Electronic Health Records (EHR) may be a valuable tool to aid detection of people with high familial risk, and this maps across to the panellists’ prioritisation of better IT. Their prioritisation of screening programmes that are more evidence-based implies that, in some countries at least, cancer screening programmes are based on unsound or outdated practices. There is a need to focus on the opportunities for primary care to enhance screening programmes, in particular risk-stratification within the population-based screening, risk-based early detection/screening and personalised screening.

The selected statements regarding the patient and GP interface with secondary care relate to speed of access: efficient channels for communication and advice, and shorter waits for specialist assessment. Health services need to assess their performance on these measures and prioritise faster access to secondary care for patients that could have cancer.

Qualitative studies are needed to describe exactly how GPs feel that these issues limit their empowerment. There is also a need for research involving GPs and other stakeholders to find out how the appropriate health policies can be promoted so that the most effective solutions are implemented.

While our Delphi panellists did not consider statements related to GPs’ training and skills to be a priority for empowering GPs in early cancer diagnosis, there is a need for more focused studies on this aspect.

Conclusion

The role of Primary Health Care is crucial for the early diagnosis of cancer, as for many patients it is their first contact with the health system. Empowering GPs in their care of these patients is likely to lead to more timely cancer diagnoses.

The Delphi process identified twelve key statements representing factors that could empower GPs to increase the number of early cancer diagnoses. These statements relate to system factors, but do not include those relating to training, skills or working efficiency. The findings provide the basis for seeking actions and policies that will support GPs in their efforts to achieve a timely diagnosis of cancer.

Supplementary material

To view supplementary material for this article, please visit https://doi.org/10.1017/S1463423622000652

Acknowledgements

The authors would like to thank all the GPs who piloted the questionnaire and those who took part in the Delphi process.

The authors would also like to thank the following non-author contributors:

Isabelle Aubin-Auger, Family Medicine Department, Paris Diderot University, France.

Peter Murchie, School of Medicine, Medical Sciences and Nutrition, University of Aberdeen, Scotland.

Iryna Mykyta, Department of Family and Internal Medicine, Uzhgorod National University, Ukraine.

Luiz Miguel Santiago, Faculty of Medicine, University of Coimbra, Portugal.

Financial support

The publication of the article in OA mode was financially supported by HEAL-Link.

Conflicts of interest

None.

Ethical standards

The panellist recruitment and the Delphi process were managed by Asst. Prof. Emmanouil Smyrnakis and Dr George Tzanis, Laboratory of Primary Health Care, General Practice and Health Services Research, Aristotle University of Thessaloniki, Thessaloniki, Greece. The study protocol was approved by the ethics committee of the School of Medicine of the Aristotle University of Thessaloniki.

Panellists received a Participant Information Sheet and a link to the online survey, where they were given information about the project, an assurance that their answers were confidential to the study coordinators and a request for their agreement to allow their data to be used in the study. Clicking on the ‘Next’ button was considered as consent for participation in the study.

Appendix 1. List of the 52 statements in 14 subject groups

Continuing medical education (CME) for General Practitioners (GPs)

GPs would be empowered to increase the number of early cancer diagnoses by…

…having regular CME for GPs.

…having better quality CME for GPs.

…having more cancer-focused CME for GPs.

GP skills & attitudes

GPs would be empowered to increase the number of early cancer diagnoses by…

…having better clinical skills.

…being dedicated to giving good quality care to patients who may have cancer.

…believing that they are competent to give good quality care to patients who may have cancer.

GP knowledge

GPs would be empowered to increase the number of early cancer diagnoses by…

…GPs knowing more about when to investigate patients because of possible cancer.

…knowing how to get the right balance between over- and under-investigation of possible cancer.

…having better knowledge of atypical cancer symptoms and signs.

…having better knowledge of early cancer symptoms and signs.

…having better knowledge of, and access to, health indicators relating to cancer (prevalence, mortality, survival rate, etc.).

GP performance

GPs would be empowered to increase the number of early cancer diagnoses by…

…being required to be competent in cancer diagnosis.

…having enough experience to be able to be confident in their care of patients who may have cancer.

GP working conditions & workload

GPs would be empowered to increase the number of early cancer diagnoses by…

…having a lower workload for GPs.

…having longer consultations.

…having better working conditions for GPs.

…having less bureaucracy for GPs.

…having more personnel in primary care.

…having better payment for GPs.

…if it were easier for patients to get a GP appointment.

Guidelines

GPs would be empowered to increase the number of early cancer diagnoses by…

…being more involved in designing cancer diagnosis guidelines and clinical pathways.

…having guidelines for non-specific symptoms that could be due to cancer.

…making more use of existing national or regional cancer guidelines.

GP teams

GPs would be empowered to increase the number of early cancer diagnoses by…

…having better coordination within the Primary Healthcare (PHC) team.

…having more continuity of GP care (so that patients can usually see the same doctor each time).

…getting more feedback from their PHC colleagues.

Health system

GPs would be empowered to increase the number of early cancer diagnoses by…

…having better financial support for early cancer diagnosis in primary care.

…having an understanding in the health system that, in order to diagnose more cancers early, they need to refer and investigate more patients.

…being under less pressure to reduce referrals.

…being more involved in planning and running primary care service.

…having an understanding in the health system that GPs’ ‘gut feelings’ are important.

Information technology (IT)

GPs would be empowered to increase the number of early cancer diagnoses by…

…having electronic reminders for when individual patients need screening tests.

…having better IT to support communication and information transfer.

…having cancer diagnosis decision support in their IT systems.

Links with secondary care

GPs would be empowered to increase the number of early cancer diagnoses by…

…having quicker, easier communication with secondary care.

…getting more feedback from secondary care.

…having shorter waiting times for secondary care.

…being able to get quick advice from secondary care.

Pathways

GPs would be empowered to increase the number of early cancer diagnoses by…

…being more involved in designing rapid access pathways for suspected cancer.

…having better availability of rapid access pathways.

…having a simpler process for referral to a specialist.

Patient issues

GPs would be empowered to increase the number of early cancer diagnoses by…

…having better public health measures to improve patients’ awareness of symptoms that could be due to cancer.

…having more reassurance that tests won’t be too expensive for their patients.

…being more trusted by their patients.

Screening

GPs would be empowered to increase the number of early cancer diagnoses by…

…having a reliable system for screening patients who have a higher familial risk of cancer.

…having clear guidelines for cancer screening.

…having screening programmes that are more evidence-based.

…providing more motivation for GPs to take part in screening.

Tests for cancer

GPs would be empowered to increase the number of early cancer diagnoses by…

…having easier GP access to tests for cancer.

…having shorter waiting times for tests for cancer.

…having special tests for cancer (CT scans or endoscopies, for example) available to GPs’ patients in the area where they live.

…being able to do diagnostic ultrasound in their practices.

Appendix 2. Number of GPs involved, by country

Appendix 3. The 52 statements and their Round 3 scores in descending order of their ‘mean statement score – SD’ value

References

Barrett, H (2020) What are Delphi studies? Evidence-Based Nursing 23, 6869. doi: 10.1136/ebnurs-2020-103303.CrossRefGoogle ScholarPubMed
Boulkedid, R, Abdoul, H, Loustau, M, Sibony, O and Alberti, C (2011) Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review. PLoS ONE. Edited by J. M. Wright. Public Library of Science 6, e20476. doi: 10.1371/journal.pone.0020476.CrossRefGoogle ScholarPubMed
British Medical Association (2020) Controlling workload in general practice strategy. Retrieved 8 February 2022 from https://www.bma.org.uk/advice-and-support/gp-practices/managing-workload/controlling-workload-in-general-practice-strategy Google Scholar
Brown, LD and Eagan, E (2004) The paradoxical politics of provider reempowerment. Journal of Health Politics, Policy and Law, 10451071. doi: 10.1215/03616878-29-6-1045.CrossRefGoogle ScholarPubMed
Cambridge Dictionary – Empowerment. Retrieved 8 February 2022 from https://dictionary.cambridge.org/dictionary/english/empowerment Google Scholar
Carrieri, D, Pearson, M, Mattick, K, Papoutsi, C, Briscoe, S, Wong, G and Jackson, M (2020) Interventions to minimise doctors’ mental ill-health and its impacts on the workforce and patient care: the care under pressure realist review. Health Services and Delivery Research NIHR Journals Library 8, 1132.Google Scholar
Dinsdale, E, Hannigan, A, O'Connor, R, O'Doherty, J, Glynn, L, Casey, M, Hayes, P, Kelly, D, Cullen, W and O'Regan, A (2020). Communication between primary and secondary care: deficits and danger. Family Practice 37(1), 6368.Google ScholarPubMed
Falk-Rafael, AR, Chinn, PL, Anderson, MA, Laschinger, H and Rubotzky, AM (2004) The effectiveness of feminist pedagogy in empowering a community of learners. Journal of Nursing Education 43, 107115.CrossRefGoogle ScholarPubMed
Fink-Hafner, D, Dagen, T, Dousak, M, Novak, M and Hafner-Fink, M (2019) Delphi method: strengths and weaknesses. Metodoloski zvezki 16, 119.Google Scholar
Foot, C and Harrison, T (2011) How to improve cancer survival: explaining England’s relatively poor rates – The King’s Fund. Retrieved 15 June 2011 from https://www.kingsfund.org.uk/sites/default/files/How-to-improve-cancer-survival-Explaining-England-poor-rates-Kings-Fund-June-2011.pdf Google Scholar
Fullam, C, Lando, AR, Johansen, ML and Reyes, ASD (1998) The triad of empowerment: leadership, environment, and professional traits. Nursing Economics Jannetti Publications, Inc. 16, 254259.Google ScholarPubMed
Fulton, AL, Williams, HRT, Shah, J, Phillips, L, Fluxman, J and Hoare, JM (2016) Specialist advice for primary care: an evaluation of a gastroenterology email advice service. Future Hospital Journal. Royal College of Physicians 3, 90. doi: 10.7861/FUTUREHOSP.3-2-90.Google ScholarPubMed
Gomy, I and Diz, MDPE (2013) Hereditary cancer risk assessment: essential tools for a better approach. Hereditary Cancer in Clinical Practice BioMed Central 11, 16. doi: 10.1186/1897-4287-11-16.CrossRefGoogle ScholarPubMed
Hamilton, W (2009) Five misconceptions in cancer diagnosis. British Journal of General Practice 59, 441445. doi: 10.3399/bjgp09X420860.CrossRefGoogle ScholarPubMed
Harris, M, Brekke, M, Dinant, G-J, Esteva, M, Hoffman, R, Marzo-Castillejo, M, Murchie, P, Neves, AL, Smyrnakis, E, Vedsted, P, Aubin-Auger, I, Azuri, J, Buczkowski, K, Buono, N, Foreva, G, Babić, SG, Jacob, E, Koskela, T, Petek, D, Šter, MP, Puia, A, Sawicka-Powierza, J, Streit, S, Thulesius, H, Weltermann, B and Taylor, G (2019) Primary care practitioners’ diagnostic action when the patient may have cancer: an exploratory vignette study in 20 European countries. BMJ Open 10, e035678.CrossRefGoogle Scholar
Harris, M, Taylor, G, Örenäs Research Group (2018) How health system factors affect primary care practitioners’ decisions to refer patients for further investigation: protocol for a pan-European ecological study. BMC Health Services Research 18, 338.Google ScholarPubMed
Institute of Medicine (US) and National Research Council (US) National Cancer Policy Board (2003) Improving participation in cancer screening programs. In Curry SJ, Byers T and Hewitt M, editors, Fulfilling the potential of cancer prevention and early detection. Washington, DC: National Academies Press (US), 1–14.Google Scholar
Irvine, D, Leatt, P, Evans, MG and Baker, RG (1999) Measurement of staff empowerment within health service organizations. Journal of Nursing Measurement 7, 7996.CrossRefGoogle ScholarPubMed
Israel, GD and Taylor, CL (1990) Can response order bias evaluations? Evaluation and Program Planning 13, 365371. doi: 10.1016/0149-7189(90)90021-N.CrossRefGoogle Scholar
Kanter, RM (1993) Men and women of the corporation. New York: Basic Books.Google Scholar
Launoy, G, Veret, JL, Richir, B, Reaud, JM, Ollivier, V, Valla, A and Gignoux, M (1993) Involvement of general practitioners in mass screening. Experience of a colorectal cancer mass screening programme in the Calvados region (France). Journal of Cancer Prevention 2, 229232.CrossRefGoogle ScholarPubMed
Linstone, HA (1985) The Delphi technique. Environmental impact assessment, technology assessment, and risk analysis. Proc., Les Arcs, 1983. Springer-Verlag; NATO ASI Series G 4, Seattle, WA, pp. 621649.CrossRefGoogle Scholar
Linstone, HA, Turoff, M and Helmer, O (1975) The Delphi method: techniques and applications. Boston, MA: Addison-Wesley.Google Scholar
Loud, JT and Murphy, J (2017) ‘Cancer Screening and Early Detection in the 21st Century’, Seminars in Oncology Nursing. Rockville, MD: W.B. Saunders, pp. 121128.Google Scholar
Mesko, B and Győrffy, Z (2019) The rise of the empowered physician in the digital health era: viewpoint. Journal of Medical Internet Research JMIR Publications Inc., e12490.CrossRefGoogle ScholarPubMed
Nicholson, BD, Mant, D and Bankhead, C (2016) Can safety-netting improve cancer detection in patients with vague symptoms? BMJ 355, i5515.CrossRefGoogle ScholarPubMed
Nyborg, G, Straand, J, Klovning, A and Brekke, M (2015) The Norwegian general practice-nursing home criteria (NORGEP-NH) for potentially inappropriate medication use: a web-based Delphi study. Scandinavian Journal of Primary Health Care 33, 134141.CrossRefGoogle ScholarPubMed
Orgambídez-Ramos, A and Borrego-Alés, Y (2014) Empowering employees: structural empowerment as antecedent of job satisfaction in university settings. Psychological Thought 7, 2836.CrossRefGoogle Scholar
Parker, L, Carter, S, Williams, J, Pickles, K and Barratt, A (2017) Avoiding harm and supporting autonomy are under-prioritised in cancer-screening policies and practices. European Journal of Cancer 85, 15.Google ScholarPubMed
Printz, C (2020) Clinician reminders increase cancer screening orders, but patients need prompts as well. Cancer John Wiley & Sons, Ltd 126, 13741375.CrossRefGoogle ScholarPubMed
Probst, HB, Hussain, ZB and Andersen, O (2012) ‘Cancer patient pathways in Denmark as a joint effort between bureaucrats, health professionals and politicians—a national Danish project’, Health policy (Amsterdam, Netherlands). Health Policy 105, 6570.CrossRefGoogle Scholar
Roller, WK (1998) Measuring empowerment the perception of empowerment instrument (PEI). Retrieved from https://www.nhqualitycampaign.org/files/PEI.pdf Google Scholar
Schäfer, WLA, van den Berg, MJ and Groenewegen, PP (2020) The association between the workload of general practitioners and patient experiences with care: results of a cross-sectional study in 33 countries. Human Resources for Health 18, 1. BioMed Central, 18(1), pp. 1–9.CrossRefGoogle ScholarPubMed
Scheepers, R, Silkens M, van den Berg J and Lombarts K (2020) Associations between job demands, job resources and patient-related burnout among physicians: results from a multicentre observational study. BMJ Open NLM (Medline) 10, e038466.CrossRefGoogle ScholarPubMed
Trus, M, Galdikiene, N, Balciunas, S, Green, P, Helminen, M and Suominen, T (2019) Connection between organizational culture and climate and empowerment: the perspective of nurse managers. Nursing and Health Sciences Blackwell Publishing 21, 5462.CrossRefGoogle ScholarPubMed
Verbeten, N (2007) The empowered physician. WMJ: Official Publication of the State Medical Society of Wisconsin 106, 458459.Google ScholarPubMed
Weller, DP, Patnick, J, McIntosh, HM and Dietrich, AJ (2009) Uptake in cancer screening programmes. Lancet Oncology 10, 693699.CrossRefGoogle ScholarPubMed
Wong, CA and Laschinger, HKS (2013) Authentic leadership, performance, and job satisfaction: the mediating role of empowerment. Journal of Advanced Nursing 69, 947959.CrossRefGoogle ScholarPubMed
Yakes, EA, Dean, S, Labadie, RF, Byrne, D, Estrada, C, Thompson, R, Kendall, J and Yarbrough, M (2020) Factors associated with physician empowerment and well-being at an academic medical center. Journal of Occupational and Environmental Medicine 62, 478483.CrossRefGoogle ScholarPubMed
Figure 0

Table 1. The Delphi panellists’ recruitment criteria

Figure 1

Figure 1. The Delphi study process.

Figure 2

Figure 2. The number of GPs initially invited and the number of panellists for each of the Delphi rounds.

Figure 3

Table 2. Demographic data of the 68 panellists who completed Round 1

Figure 4

Table 3. Mean standard deviation (SD) of Likert scale scores for all the statements in the three Delphi rounds

Figure 5

Table 4. The 12 statements satisfying the pre-defined Delphi selection criterion

Supplementary material: File

Tzanis et al. supplementary material

Tzanis et al. supplementary material 1

Download Tzanis et al. supplementary material(File)
File 36.7 KB
Supplementary material: File

Tzanis et al. supplementary material

Tzanis et al. supplementary material 2

Download Tzanis et al. supplementary material(File)
File 37.3 KB
Supplementary material: File

Tzanis et al. supplementary material

Tzanis et al. supplementary material 3

Download Tzanis et al. supplementary material(File)
File 42.8 KB