Skip to main content

Adding a second surprise question triggers general practitioners to increase the thoroughness of palliative care planning: results of a pilot RCT with case vignettes



In our aging society, palliative care should be a standard component of health care. However, currently it is only provided to a small proportion of patients, mostly to those with cancer, and restricted to the terminal phase. Many general practitioners (GPs) say that one of their most significant challenges is to assess the right moment to start anticipatory palliative care. The “Surprise Question” (SQ1: “Would I be surprised if this patient were to die in the next 12 months”?), if answered with “no”, is an easy tool to apply in identifying patients in need of palliative care. However, this tool has a low specificity. Therefore, the aim of our pilot study was to determine if adding a second, more specific “Surprise Question” (SQ2: “Would I be surprised if this patient is still alive after 12 months”?) in case SQ1 is answered in the negative, prompts GPs to plan for anticipatory palliative care.


By randomization, 28 GPs in the south-eastern part of the Netherlands were allocated to three different groups. They all received a questionnaire with four vignettes, respectively representing patients with advanced organ failure (A), end stage cancer (B), frailty (C), and recently diagnosed cancer (D). GPs in the first group did not receive additional information, the second group received SQ1 after each vignette, and the third group received SQ1 and SQ2 after each vignette. We rated their answers based on essential components of palliative care (here called RADIANT score).


GPs in group 3 gave higher RADIANT scores to those vignettes in which they would be surprised if the patients were still alive after 12 months. In all groups, vignette B had the highest mean RADIANT score, followed by vignettes A and C, and the lowest on vignette D. Seventy-one percent of GPs in groups 2 and 3 considered SQ1 a helpful tool, and 75% considered SQ2 helpful.


This innovative pilot study indicates that the majority of GPs think SQ2 is a helpful additional tool. The combination of the two “Surprise Questions” encourages GPs to make more specific plans for anticipatory palliative care.

Peer Review reports


Today most people in the Western world die of chronic, degenerative illnesses and malignancies, rather than of acute lethal diseases [1]. This implies that patients have a longer deteriorating trajectory, with increased symptom burden. For patients, carers, and family members, multidimensional supportive or palliative care is needed, preferably starting during disease-targeted care [1, 2]. The WHO defines palliative care as an early, multidimensional, proactive approach to maintaining or retaining quality of life alongside acceptance of mortality and bereavement. However, a means of demonstrating that a medical professional has fulfilled each of these requirements is not currently available [3].

Temel et al. demonstrated that timely palliative care in patients with metastatic non-small cell lung cancer alongside standard treatment increased their quality of life, reduced depressed mood, and even prolonged survival, as compared with standard treatment alone. Bakitas et al. showed that early initiation of palliative care as compared to late initiation led to an increase in life expectancy of cancer patients [4, 5]. Patients with other life-limiting diseases are also in need of early palliative care and may benefit from it [6,7,8].

Most patients in an advanced stage of a life-limiting disease live at home in the Netherlands, where the general practitioner (GP) acts as a gatekeeper and coordinator of caregiving. This makes the GP the appropriate health care professional to coordinate palliative care [9]. Unfortunately, despite efforts to promote timely palliative care planning and development of tools to identify patients who might benefit from this approach, most GPs only provide terminal, reactive care, mostly to patients with cancer [10]. Consequently, in many patients in an advanced stage of a life-limiting disease, anticipation of future problems, needs, the patient’s wishes, and mortality scenarios, does not occur in a timely fashion [3]. One of the barriers to providing anticipatory palliative care is identifying the right moment to start it, particularly in patients with organ failure or frailty [11]. To assist GPs in the identification of patients in need of anticipatory care planning, several tools have been developed [12]. However, most tools contain many items and are time-consuming to apply, when time is at a premium [13,14,15].

A way to assess the right moment to start palliative care that costs little time is the “Surprise Question” (SQ): “Would I be surprised if this patient were to die in the next 12 months?” [16] It appears to be sensitive for predicting 1-year mortality [17,18,19,20,21,22,23]. However, it has a low specificity and inadequate predictive value, which means that many identified patients live longer than one year. Therefore, just asking the SQ will identify a patient group that might be too large for a GP to provide structured, anticipatory care to. For that reason, there is a need for an easily applied tool with a higher specificity. Hence, we suggested an additional SQ that reads “Would I be surprised if this patient is still alive after 12 months?” when SQ1 is answered in the negative. Up to now, the value of the addition of this second SQ in encouraging proactive palliative care has not been explored, which makes this paper a unique contribution to the international literature.

We pilot tested whether adding SQ2 to SQ1 increases the thoroughness of palliative care planning among GPs and asked whether GPs think the double SQ is useful and applicable in daily practice.


Study design and participants

Between April and July 2016, we invited a random sample of 140 GPs in the south-eastern part of the Netherlands to participate in our pilot vignette study. Because the second SQ had never been studied before, we performed a pilot RCT. We estimated that about 30% of invited GPs would be willing to participate. Thus, by inviting 140 GPs to participate, we would have about 10 participating GPs per group. This number was expected to be sufficient to answer the research questions, keeping in mind the explorative character of this innovate study. In order to prevent socially desirable answering, we told participating GPs that the purpose of the study was to explore the influence of the type of patient illness on GP’s care planning, without mentioning that we were also interested in the influence of the SQs. For the same reason, we did not mention that they would be randomized. Forty-three GPs provided written informed consent, and were randomized to one of the four arms, after stratification for being a “specialized GP” (a GP who has completed an extensive additional course in Palliative care or in Elderly care). In each group, the GPs received a questionnaire with four vignettes [Additional file 1]. Group 1 was used as a control group. Group 2 received only SQ1 after each vignette and in group 3 both SQs (SQ1 and SQ2) were asked after each vignette.

Group 4 received an aid for anticipatory, multidimensional care planning after each vignette in addition to both SQs. However, this concerned another research question; for that reason, in this paper we will only report the results of groups 1–3.


All participating GPs received the randomization-assigned questionnaire online through Castor EDC (a valid research database software program), or by mail, according to their preference.

Each questionnaire contained four vignettes representing four different patient cases. Vignette A portrays a patient at an advanced stage of a chronic condition (chronic heart failure and chronic obstructive pulmonary disease), vignette B a patient with terminal metastatic pancreatic cancer, vignette C a frail lady with dementia and vignette D a relatively young patient with a recently diagnosed metastatic colon carcinoma. These vignettes were inspired by real anonymized cases from one of the authors (CV). [Additional file 1].

With each vignette, the respondent was asked if he would plan any kind of care for this particular patient. If so, they were asked to describe what instructions they would give to their young and inexperienced GP-trainee (who therefore needs explicit instructions) and about what kind of care needs to be planned for this patient in the upcoming period. At the end of the questionnaire, GPs in the corresponding groups were asked their opinions about the applicability and usefulness of, respectively, SQ1 and SQ2 [Table 1].

Table 1 Questions asked to the GPs regarding palliative care provision

Outcome measures

All invited GPs were asked to provide socio-demographics and palliative care experience-related data [Table 2]. All information provided in the questionnaire was collected anonymously in Castor EDC and blindly evaluated. As a scoring instrument did not exist to assess whether all requirements of the WHO palliative care definition are fulfilled, we created a scoring instrument in order to analyze the open text fields and quantify them, dubbed the RADboud Indicators of ANTicipatory care (RADIANT) score [Table 3]. Therefore, we searched for guidelines from Pallialine (a Dutch website with an evidence and consensus based collection of palliative care guidelines, powered by the Netherlands Comprehensive Cancer Organization; IKNL), requirements from the WHO concerning Palliative Care and information from (a Dutch website for patients, powered by the Dutch College of General Practitioners, with clear information about various subjects including treatment limitations and end-of-life preferences) and a list of discussion points about patients’ end of life, powered by the Royal Dutch Medical Association [3, 24,25,26].

Table 2 Baseline characteristics
Table 3 RADIANT scoring table

The primary outcome was the correlation between answer combinations for SQ1 and SQ2 (“Yes/No I would / would not be surprised if this patient were to die in the next 12 months” and “Yes/No I would / would not be surprised if this patient is still alive after 12 months”) and RADIANT scores. If an answer combination of SQ1: “No” and SQ2: “Yes” correlates with higher RADIANT scores than answer combination of SQ1: “No” and SQ2: “No”, it suggests that this answer combination prompts GPs to plan anticipatory care more thoroughly.

Secondary outcomes were

a. differences in mean RADIANT scores per vignette A-D between the three GP-groups, particularly between the group with only SQ1 (group 2) and the group with both SQs (group 3). This difference in scores represents the extra value of the double SQ, as compared to SQ1 alone, in prompting GPs to plan anticipatory palliative care and the quality and thoroughness of care they described.

b. differences in mean RADIANT scores of all groups together between the cases in vignettes A-D. (Do the cases (type and progression of disease) influence the time-point, kind, and extent of care planning?)

c. differences between study group 1–3 in how often various aspects of the RADIANT score are mentioned in care plans.

d. Finally, with open questions, we qualitatively explored how GPs evaluated the single SQ and the double SQ.

Statistical analysis

Continuous, normally distributed data were expressed as means and percentages. Because of the small numbers, no effect sizes were calculated.

Ethical justification

The study was approved by the research ethics committee of Radboud university medical center in accordance with the Medical Research Involving Human Subjects Acts (WMO), case number 2016–2716. We obtained written consent from all participants to report individual anonymized data.


Study participants

Of the 140 GPs approached, 57 did not want to participate and 40 never answered our invitation; thus in total 97 GPs did not provide informed consent [Fig. 1]. Fourty-three GPs agreed to participate and were randomized into groups 1–4 and sent the corresponding questionnaire. Of those 33 were in groups 1–3. Twenty-eight GPs completed the questionnaire and 5 did not, mostly due to high workload or personal circumstances [Fig. 1]. Of these 28 GPs, nine were in group 1, ten in group 2, nine in group 3. Their characteristics are included in Table 2.

Fig. 1

Flowchart study participants. Legend: -

Characteristics of participants in the different groups were mostly similar. However, the percentage of males in group 2 was lower and the percentage of GP-trainers in group 1 was lower. The mean age was 49 (SD 9.2) and they had an average GP work experience of 18 (SD 9.4) years. Four GPs worked in an individual practice (14%), 11 GPs (39%) in a two-man practice and 13 (46%) in a group practice. Only one of them (4%) completed an additional course in palliative care or in elderly care and 14 (50%) were GP-trainers. Participants treated a mean of six palliative patients a year, and GPs rated their interest in palliative care as an 8.0 (scale 0–10; 0: not at all-10: extremely interested) and their self-assessed expertise in palliative care as a 7.2 (scale 0–10; 0: no expertise-10: extremely high expertise).

Primary outcome measure: Correlation between answer combinations on SQ1 and SQ2 and RADIANT scores

In group 3, GPs who answered that they would not be surprised if this patient were to die in 12 months, and would be surprised if this patient is still alive after 12 months, had higher RADIANT scores than GPs in the same group who answered that they would not be surprised if this patient were to die in 12 months but they would also not be surprised if this patient is still alive after 12 months [Table 4].

Table 4 Answers on SQ1a and SQ2b and RADIANT scoresc per groupd and per vignette

Secondary outcome measures

We did not find differences between GPs groups 1–3 in Radiant scores. Regarding vignettes A, B and D, group 3 has lower scores than group 1 and 2 [Table 5]. In all groups, vignette B (end-stage metastatic pancreatic cancer) had the highest mean score, followed by vignettes A (advanced organ failure) and C (frailty), and the lowest on vignette D (recently diagnosed metastatic colon carcinoma). In group 3, those vignettes of whom the GPs would be surprised if they were still alive after one year had mostly higher Radiant scores than the others. [Table 5].

Table 5 Mean cumulative RADIANT scoresa per group, per vignette and per SQ answer combination

GPs mentioned specific treatment limitations least often in their care plans and in only three care plans (3%) GPs mentioned that they would discuss how to achieve patients’ personal goals. There were no striking differences between groups 1–3, except for involving other disciplines (50% of the case vignettes in group 1, compared to 20% for groups 2 and 3) and involving family and loved ones in planning care (36% of the case vignettes in group 1, compared to 22% and 25% in groups 2–3 respectively).

GPs’ opinion about triggers to start palliative care

Many GPs mentioned that, in general, the diagnosis of a disease without curative options prompts them to start a palliative care approach. Their intuition, or information from a medical specialist, that death is approaching are considered important triggers. They also mentioned that they are prompted by frailty, complex situations, or when a patient suddenly or gradually has increased care needs. These latter situations give a GP the feeling of lagging behind events and of no longer being able to act proactively: the feeling of being overtaken by events.” Also, the absence of a family caregiver or lack of a social network prompts them to initiate palliative care. Some GPs especially want to adhere to the patient’s wishes and start palliative care when the patient himself asks for it or gives other signals of being open to a conversation about palliative care: the tangibility of the finiteness of life and the patient’s capacity to feel this too.” One GP in group 1 described SQ1 as an important trigger, another GP in group 1 mentioned SQ2, although they were not offered these questions and SQ2 has not been described before.

In the groups that received it, 12 out of 17 GPs who answered SQ1 (71%) considered it a helpful tool. However, GPs mentioned the inadequate specificity: “for anyone over 85, this could be their last year, but I will not start a palliative approach for all of them.” Regarding SQ2, 6 out of 8 GPs who answered it (75%) considered it helpful. Some of them already were familiar with SQ1 and found it helpful to determine the right moment to start anticipatory palliative care planning. One GP in group 3 noted: “I use the first surprise question on a regular basis, but the second one is new to me. They seem to be the same, but surely there is a nuanced difference. When the answer to SQ1 is ‘No’ and to SQ2 is ‘Yes’, it is clearer to me that the palliative phase has begun. The only objection is that these questions are subjective and therefore a physician can make a very inaccurate estimation. So I suggest answering these two SQs over again when the situation changes.”


Up to now, the classical SQ(1) alone was used and has proven to have low specificity as a tool to predict death, which may lead to a large and unselected group of patients for whom a GP should plan multidimensional, proactive, palliative care. Some participating GPs in this study underlined this shortcoming. Furthermore, its performance is insufficient in non-cancer patients [23]. Adding SQ2 to SQ1 may improve specificity as prognostic tool, but more meaningfully, combining the two SQs will help a medical professional to select a smaller, more accessible group of patients in need of anticipatory palliative care. The GP can then focus on these patients and plan palliative care more thoroughly.

Many tools have recently been developed to identify patients in need of palliative care in general practice, e.g. RADPACT, SPICT, NEPCAL, GSF [12]. These tools require more time investment and availability of indicators and are therefore less suitable for screening of patients in a GP’s daily practice. Also, most tools are focused on the palliative patient in the terminal phase, which implies that after identification there will be less time for proactive and anticipatory care planning. However, all of these tools are useful for meeting patients’ wishes, needs, and possible future scenarios and should be used in combination during conversations with the patient.

We did not study the prognostic value of the SQs. Already in 2005 Lynn suggested using the SQ to identify “whether the person is in a fragile enough condition that relatively minor worsening or intercurrent illnesses could lead to mortality. Some of the patients identified by the surprise question will end up living for years in a fragile state, and some will die soon, but all typically need the services that are priorities in the last phase of life: advance care planning, comfort measures, assistance for daily activities, family support, and so forth” [27]. Also Downar et al. noted the importance of using the SQ as a screening test for patients who might benefit from a palliative care approach [28]. Recognizing the patient in need is a prerequisite to starting proactive palliative care [29], not the prognosis.

Most participating GPs considered the already-known SQ1 and also the new SQ2 helpful.

As one of the triggers to start palliative care, some GPs mentioned “if a patient himself asks for it”. However, De Vleminck et al. demonstrated that patients, and particularly patients with disease trajectories other than cancer, are very unlikely to start discussing anticipatory care planning on their own initiative [30].

Strengths and limitations

This is the first study in which the SQ is used in combination with case vignettes to see whether it prompts GPs to thoroughly plan proactive palliative care, instead of studying its prognostic value, which has been questioned before [31]. Adding a more specific trigger, SQ2, is also innovative.

However, the study also has several limitations. In this pilot study, the number of included GPs was limited and not sufficient to discover statistical significance. It was meant as a first exploration and therefore all results should be interpreted with caution. Although we aimed to use the results for a full-scale study, the relatively small percentage of GPs that wanted to participate in this vignette study led us to abandon this plan. Instead, we have started a prospective study in which GPs screened their patient list with both SQs. One year later, a retrospective medical record review will take place to determine sensitivity and specificity of both SQs and whether the different answers to these SQs are related to anticipatory care planning and care needs.

The response rate of 22% is about the same as in Schnakenberg et al.’s study (27.5%). In that study, GPs in Germany and Sweden were sent surveys about palliative care, which took no more than ten minutes to fill out [32]. Although we consider 22% fairly low, given the time required to complete the questionnaire (30–40 min) and Dutch GPs’ high workload, it is satisfactory.

Vignette 4, concerning the patient with recently diagnosed metastatic colon carcinoma, was not completed by two GPs and also had the lowest RADIANT score. We think that mainly the case itself will have influenced the score, but maybe the order in which the vignettes were presented might have influenced this outcome as well.

Although the RADIANT score is not a validated tool, it enabled us to quantify the open text fields and thus to compare groups not only qualitatively but also quantitatively. We chose anticipatory care to have a high share of the total RADIANT score, because we believe a medical professional can only provide good palliative care when, in addition to addressing actual problems, he also anticipates possible future problems. Besides, a medical professional can only be proactive when he is made aware of his patient’s condition, which is what we aimed to achieve with the SQs.

Whether the RADIANT score is related to the quality of a palliative care plan (the obtained scores are a fraction of the total possible score per vignette of 21 points) still needs to be studied in real patient care, as well as the validity and specificity of the tool.

Finally, we do not know whether all GPs in group 3 have understood the subtle but essential difference between SQ1 and SQ2. After all, we did not provide any explanation about the intention or use of this new SQ2.


This simple, additional SQ2 was considered helpful by GPs and showed promising pilot results. In four prospective studies in, respectively, general practice, a medical oncology outpatient clinic, the Intensive Care Unit and nursing homes, we will further explore its usefulness and validity.


In our pilot study, SQ2 in addition to SQ1 seems to contribute to more extensive and anticipatory palliative care planning for those patients of whom GPs would be surprised if they were still alive after 12 months, and to less extensive and anticipatory care planning when they would not be surprised if a patient were still alive after 12 months. Most GPs who received it considered SQ2 a useful addition to SQ1.



General Practitioner


Radboud Indicators of Anticipatory care


Would I be surprised if this patient were to die within the next 12 months?


Would I be surprised if this patient is still alive after 12 months?


  1. 1.

    Seale C. Changing patterns of death and dying. Social science & medicine (1982). 2000;51(6):917–30.

    CAS  Article  Google Scholar 

  2. 2.

    Thoonsen B, Groot M, Engels Y, Prins J, Verhagen S, Galesloot C, van Weel C, Vissers K. Early identification of and proactive palliative care for patients in general practice, incentive and methods of a randomized controlled trial. BMC Fam Pract. 2011;12:123.

    Article  PubMed  PubMed Central  Google Scholar 

  3. 3.

    World Health Organisation (WHO) Definition of Palliative Care. Accessed 29 October 2017.

  4. 4.

    Temel JS, Greer JA, Muzikansky A, Gallagher ER, Admane S, Jackson VA, Dahlin CM, Blinderman CD, Jacobsen J, Pirl WF, et al. Early palliative care for patients with metastatic non-small-cell lung cancer. N Engl J Med. 2010;363(8):733–42.

    CAS  Article  PubMed  Google Scholar 

  5. 5.

    Bakitas MA, Tosteson TD, Li Z, Lyons KD, Hull JG, Li Z, Dionne-Odom JN, Frost J, Dragnev KH, Hegel MT, et al. Early versus delayed initiation of concurrent palliative oncology care: patient outcomes in the ENABLE III randomized controlled trial. Journal of clinical oncology : official journal of the American Society of Clinical Oncology. 2015;33(13):1438–45.

    Article  Google Scholar 

  6. 6.

    Evangelista LS, Lombardo D, Malik S, Ballard-Hernandez J, Motie M, Liao S. Examining the effects of an outpatient palliative care consultation on symptom burden, depression, and quality of life in patients with symptomatic heart failure. J Card Fail. 2012;18(12):894–9.

    Article  PubMed  PubMed Central  Google Scholar 

  7. 7.

    Wong FK, Ng AY, Lee PH, Lam PT, Ng JS, Ng NH, Sham MM. Effects of a transitional palliative care model on patients with end-stage heart failure: a randomised controlled trial. Heart. 2016;102(14):1100–8.

    Article  PubMed  PubMed Central  Google Scholar 

  8. 8.

    Brannstrom M, Boman K. Effects of person-centred and integrated chronic heart failure and palliative home care. PREFER: a randomized controlled study. Eur J Heart Fail. 2014;16(10):1142–51.

    Article  PubMed  Google Scholar 

  9. 9.

    Gomes B, Calanzani N, Curiale V, McCrone P, Higginson IJ. Effectiveness and cost-effectiveness of home palliative care services for adults with advanced illness and their caregivers. The Cochrane database of systematic reviews. 2013;6:Cd007760.

    Google Scholar 

  10. 10.

    Abarshi EA, Echteld MA, Van den Block L, Donker GA, Deliens L, Onwuteaka-Philipsen BD. Recognising patients who will die in the near future: a nationwide study via the Dutch sentinel network of GPs. The British journal of general practice : the journal of the Royal College of General Practitioners. 2011;61(587):e371–8.

    Article  Google Scholar 

  11. 11.

    De Vleminck A, Houttekier D, Pardon K, Deschepper R, Van Audenhove C, Vander Stichele R, Deliens L. Barriers and facilitators for general practitioners to engage in advance care planning: a systematic review. Scand J Prim Health Care. 2013;31(4):215–26.

    Article  PubMed  PubMed Central  Google Scholar 

  12. 12.

    Maas EA, Murray SA, Engels Y, Campbell C. What tools are available to identify patients with palliative care needs in primary care: a systematic literature review and survey of European practice. BMJ Support Palliat Care. 2013;3(4):444–51.

    Article  PubMed  Google Scholar 

  13. 13.

    Thoonsen B, Engels Y, van Rijswijk E, Verhagen S, van Weel C, Groot M, Vissers K. Early identification of palliative care patients in general practice: development of RADboud indicators for PAlliative care needs (RADPAC). The British journal of general practice : the journal of the Royal College of General Practitioners. 2012;62(602):e625–31.

    Article  Google Scholar 

  14. 14.

    Claessen SJ, Francke AL, Engels Y, Deliens L. How do GPs identify a need for palliative care in their patients? An interview study. BMC Fam Pract. 2013;14:42.

    Article  PubMed  PubMed Central  Google Scholar 

  15. 15.

    Gómez-Batiste X, Murray SA, Thomas K, Blay C, Boyd K, Moine S, Gignon M, Van den Eynden B, Leysen B, Wens J, Engels Y, Dees M, Costantini M. Comprehensive and integrated palliative care for people with advanced chronic conditions: An update from several European initiatives and recommendations for policy. J Pain Symptom Manage. 2017;53:509–17.

  16. 16.

    Pattison M, Romer AL. Improving care through the end of life: launching a primary care clinic-based program. J Palliat Med. 2001;4(2):249–54.

    CAS  Article  PubMed  Google Scholar 

  17. 17.

    Moroni M, Zocchi D, Bolognesi D, Abernethy A, Rondelli R, Savorani G, Salera M, Dall'Olio FG, Galli G, Biasco G, et al. The 'surprise' question in advanced cancer patients: a prospective study among general practitioners. Palliat Med. 2014;28(7):959–64.

    Article  PubMed  Google Scholar 

  18. 18.

    Moss AH, Lunney JR, Culp S, Auber M, Kurian S, Rogers J, Dower J, Abraham J. Prognostic significance of the "surprise" question in cancer patients. J Palliat Med. 2010;13(7):837–40.

    Article  PubMed  Google Scholar 

  19. 19.

    Moss AH, Ganjoo J, Sharma S, Gansor J, Senft S, Weaner B, Dalton C, MacKay K, Pellegrino B, Anantharaman P, et al. Utility of the "surprise" question to identify dialysis patients with high mortality. Clin J Am Soc Nephrol. 2008;3(5):1379–84.

    Article  PubMed  PubMed Central  Google Scholar 

  20. 20.

    Pang WF, Kwan BC, Chow KM, Leung CB, Li PK, Szeto CC. Predicting 12-month mortality for peritoneal dialysis patients using the “surprise” question. Perit Dial Int. 2013;33(1):60–6.

    Article  PubMed  PubMed Central  Google Scholar 

  21. 21.

    Da Silva Gane M, Braun A, Stott D, Wellsted D, Farrington K. How robust is the 'surprise question' in predicting short-term mortality risk in haemodialysis patients. Nephron Clin Pract. 2013;123(3–4):185–93.

    Article  PubMed  Google Scholar 

  22. 22.

    Cohen LM, Ruthazer R, Moss AH, Germain MJ. Predicting six-month mortality for patients who are on maintenance hemodialysis. Clin J Am Soc Nephrol. 2010;5(1):72–9.

    Article  PubMed  PubMed Central  Google Scholar 

  23. 23.

    Downar J, Goldman R, Pinto R, Englesakis M, Adhikari NK. The “surprise question” for predicting death in seriously ill patients: a systematic review and meta-analysis. CMAJ. 2017;189(13):E484–93.

    Article  PubMed  PubMed Central  Google Scholar 

  24. 24.

    Pallialine: General principles of palliative care. [] Accessed 14 Apr 2018.

  25. 25.

    Information for patients about end-of-life decisions and treatment limitations [] Accessed 14 Apr 2018.

  26. 26.

    Talk timely to your patient about end of life issues [] Accessed 14 Apr 2018.

  27. 27.

    Lynn J: Living long in fragile health: the new demographics shape end of life care. Hastings Cent Rep 2005, Spec No:S14–S18.

  28. 28.

    Downar JGR, Pinto R, Englesakis M, Adhikari NK. The “surprise question” for predicting death in seriously ill patients: a systematic review and meta-analysis. CMAJ. 2017;189(13):484–93.

    Article  Google Scholar 

  29. 29.

    Highet G, Crawford D, Murray SA, Boyd K. Development and evaluation of the supportive and palliative care indicators tool (SPICT): a mixed-methods study. BMJ Support Palliat Care. 2014;4(3):285–90.

    Article  PubMed  Google Scholar 

  30. 30.

    De Vleminck A, Pardon K, Beernaert K, Deschepper R, Houttekier D, Van Audenhove C, Deliens L, Vander Stichele R. Barriers to advance care planning in cancer, heart failure and dementia patients: a focus group study on general practitioners' views and experiences. PLoS One. 2014;9(1):e84905.

    Article  PubMed  PubMed Central  Google Scholar 

  31. 31.

    Janssen DJA, Van de Beuken-Van Everdingen, MHJ, Schols, MGA: Suprised by the 'surprise question' Ned Tijdschr Geneeskd 2015:159:A8427.

  32. 32.

    Schnakenberg R, Goeldlin A, Boehm-Stiel C, Bleckwenn M, Weckbecker K, Radbruch L. Written survey on recently deceased patients in Germany and Switzerland: how do general practitioners see their role? BMC Health Serv Res. 2016;16:22.

    Article  PubMed  PubMed Central  Google Scholar 

Download references


We thank all GPs for participation in our vignette study.


No funding.

Availability of data and materials

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

Author information




CV developed SQ2 and the vignettes. FW has developed the questionnaire, sent invitations to GPs, collected data and drafted the manuscript. YE wrote the project proposal and led the project. CV, CV, KV and YE revised the manuscript critically for important intellectual content. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Y. Engels.

Ethics declarations

Authors’ information

F. Weijers; MD, special interest in Palliative Care.

C. Veldhoven; MD General Practitioner in Berg en Dal, the Netherlands, palliative care specialist; Department of Anesthesiology, Pain and Palliative Medicine.

C. Verhagen; MD PhD Medical Oncologist and palliative care specialist; Department of Anesthesiology, Pain and Palliative Medicine and department of Medical Oncology.

K. Vissers; MD PhD FIPP Professor in Pain and Palliative Medicine; Department of Anesthesiology, Pain and Palliative Medicine.

Y. Engels; PhD Associate professor in timely palliative care and member of Department of Anesthesiology, Pain and Palliative Medicine.

Ethics approval and consent to participate

The study was approved by the research ethics committee of Radboud university medical center in accordance with the Medical Research Involving Human Subjects Acts (WMO) and the declaration of Helsinki, case number 2016–2716. We obtained written informed consent from all of the participants.

Consent for publication

We obtained written informed consent of the participants to publish individual anonymized data.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

Case vignettes. Case vignettes. Case vignettes, representing four different patient cases, inspired by real anonymized cases of one of the authors CV. (PDF 193 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Weijers, F., Veldhoven, C., Verhagen, C. et al. Adding a second surprise question triggers general practitioners to increase the thoroughness of palliative care planning: results of a pilot RCT with case vignettes. BMC Palliat Care 17, 64 (2018).

Download citation


  • Palliative care
  • Surprise question
  • Identifying tool
  • General practitioner