- Research article
- Open Access
Variation in physician recommendations, knowledge and perceived roles regarding provision of end-of-life care
BMC Palliative Care volume 14, Article number: 52 (2015)
There is high variability in end-of-life (EOL) treatments. Some of this could be due to differences in physician treatment recommendations, their knowledge/attitude regarding palliative care, and their perceived roles in treating patients with advanced serious illness (ASI). Thus, the objective of this paper was to identify potential variation in physician recommendations, their knowledge/attitude regarding palliative care and perceived roles in treating ASI patients.
A cross-sectional survey consisting of vignettes describing patient characteristics that varied by age, expected survival, cognitive status and treatment costs and asked physicians whether they would recommend life-extending treatments for each scenario, was administered to 285 physicians who treat ASI patients in Singapore. Physicians were also assessed on their knowledge/attitude in palliative care. They were administered a best-worst scaling exercise requiring them to select their most and least important role as a physician caring for an ASI patient.
There was a wide variation in physician recommendations for life-extending treatments for patients with similar profiles, which can partly be attributed to physician characteristics (years of experience and place of training). Only about one-fourth of the physicians answered all knowledge/attitude questions correctly. Statements assessing knowledge/attitude regarding pain management had the fewest correct responses. The most important perceived role regarding provision of EOL care concerned symptom management.
Results suggest that variation in physician treatment recommendations may be partly related to their own characteristics, raising concerns regarding the EOL care being provided to patients. Efforts should be made to better understand this variation and to provide the physicians with additional training in key aspects of palliative care management.
Variation in medical practice is a common phenomenon [1, 2] and although understudied, is likely to be large among patients with advanced serious illnesses (ASI), such as those with advanced cancers or advanced organ failures, for which treatment options are largely restricted to life extension or palliation of symptoms. Such variation can be appropriate and beneficial if it occurs due to differences in illness characteristics or patient preferences. However if the variation in treatment recommendations for these patients, such as whether or not to recommend a life extending treatment, is independent of patient characteristics or preferences, and is due to physician characteristics or their practice style, then this raises questions about whether patients are receiving the best possible care at the end of life (EOL) and whether healthcare resources are being used optimally.
Research documents variation in physician practice styles or recommendations for a range of services and conditions [3–11]. Such variation may relate to differences in cost,  patient age,  presence of cognitive impairment,  health care systems, [3, 4] cultural or health care beliefs,  and treatment guidelines . The relationship with patient’s cognitive status may be due to caregiver or physician attitudes regarding perceived benefit of treatment to patients with dementia. Equivalent research for ASI patients in Singapore (the setting for this study), though presently lacking, is likely to indicate that variation in physician practice styles will be large as patients (and caregivers) often defer to their physicians for final decisions regarding treatment  and much of the care is paid out-of-pocket . The latter point is especially salient as the lack of a third party payer affords physicians greater flexibility in treatment recommendations, with fewer concerns about coverage, oversight, and reimbursement guidelines.
Variation in treatment of patients with ASI may also result from variation in knowledge/attitude and perceived roles of physicians in managing such patients. In Singapore, most EOL care is provided by non-palliative care physicians who have little training in palliative care [9, 10]. Poor knowledge due to absence of training may result in poor management of patients. Furthermore, control of pain and other symptoms has traditionally received lower priority in care of patients with cancer and other ASI as compared to extending patient’s life . This may be related to (non-palliative care) physicians’ perception of their role in primarily providing life-extending treatments as opposed to managing their symptoms. If so, these physicians may be less likely to provide palliative care to patients.
It is challenging to identify the causes of variation in treatment patterns for patients with ASI in the real world given differences in health status, patient and caregiver preferences, socio-demographics and other factors. Therefore, we attempted to address this issue via a carefully designed survey of physicians who treat patients with ASI in Singapore. The survey aimed to ascertain the variation in physician recommendations for life-extending treatments for ASI patients, their knowledge/attitude regarding palliative care provision and their perceived roles regarding provision of EOL care. We hypothesized that there will be a large variation in physician recommendations, which will systematically vary by their characteristics (age, gender, experience, country of medical training and training in palliative care), that they will lack appropriate knowledge/attitude about palliative care provision and that extending patient’s life for as long as possible will be the most important perceived role of physicians. If confirmed, then this might raise concerns that patients are receiving sub-optimal care at the EOL.
Setting and sample
Between June and December 2013, the study team invited physicians to take the study at departmental meetings for select departments at the four largest public hospitals in Singapore, and sent email requests to physicians via electronic mailing lists maintained by select medical groups. Departments that are expected to receive large numbers of ASI patients, e.g., Medicine, Surgery, Oncology, Cardiology etc. were selected for the study. A convenience sample of 285 (179 on-line and 106 on paper) physicians who treat patients with ASI in Singapore responded to the survey, with the overwhelming majority (93.3 %) coming from public sector hospitals and clinics. Informed written consent was obtained from all participants. The study was approved by the Institutional Review Board at the National University of Singapore. Dataset for this study is available on request. A brief description of Singapore’s health care system is in Additional file 1.
In the first section of the questionnaire, nine vignettes described a hypothetical patient with ASI. All physicians answered all of the nine vignettes in the survey questionnaire. Previous studies have shown vignettes to be a valid tool in measuring clinical practice variation [12, 13]. Each vignette in our study was identical except for 4 attributes that systematically varied with 3 levels each: patient age (35, 55, 75 years), median life-extension associated with the treatment option (4, 12, 24 months), 5-year survival rate associated with the treatment option (1, 5, 10 %), and cost of the treatment (S$10,000, S$55,000, S$100,000). The specific attribute levels were selected to elicit large variation in responses and were pre-tested before the main survey. The nine vignettes were chosen such that each attribute level appeared three times and only once with every other level from other attributes. This experimental design, generated by Sawtooth SSI web,  allows for estimating unbiased main effects of each level on choice of outcome. An example vignette is shown in Table 1, Panel A.
In the next section, physicians were presented with seven statements (Table 1, Panel B) to assess their knowledge/attitude regarding palliative care and pain management for patients with ASI and asked to indicate whether or not each statement was true or false. If their response matched with the most appropriate response, it was deemed to be correct. These statements and their most appropriate responses were generated through a review of literature and discussion among investigators and their content was validated by several palliative care physicians.
Finally, physicians were presented with a best-worst scaling exercise to elicit their perception about their most and least important roles in treating a patient at the EOL. Best-worst scaling is a method of eliciting stated preferences that has been found to be superior in differentiating between individual preferences as compared to rating or Likert scales [15–17]. In this method, respondents are asked to make their best and worst choices from a series of choice sets containing 3 or more attributes/items. This method assumes that respondents find it easier to choose between extremes in a set of 3 or more items. In this survey, we identified 9 physician perceived roles from a review of literature and discussion amongst investigators. These were pilot tested prior to fielding. Pilot testing was done to ensure that all statements were clear and relevant for physicians; those unclear or were not chosen as either best or worst in any of the tasks, were subsequently removed or modified. We then used a balanced incomplete block design  to create 12 choice sets. A balanced incomplete block design is an experimental design which gives fixed set sizes (in this case the set size was 3), and each attribute/item has equal occurrence and co-occurrence (in this case, each item/role appeared 4 times, every time with two different roles). This helps to minimize any design-induced bias. The roles and an example task are included in Table 1, Panel C.
For vignettes, we calculated the percentage of physicians recommending treatment for each of the attribute levels for patients with and without cognitive impairment. We then ran logistic regression model to estimate the effect of each attribute level and physician characteristics (gender, years of experience, palliative care training received and country of basic medical training) on treatment recommendations. Logistic regression was used as the dependent variable (whether or not the physician recommends a life extending treatment) is binary. We tested the model for any specification error (using linktest in STATA) and goodness-of-fit (Hosmer and Lemeshow's goodness-of-fit test). Results showed that the model was adequately specified (linktest was not statistically significant) and had good fit (p-value for Hosmer and Lemeshow’s test = 0.75). Separate model was run for vignette responses referring to patients with cognitive impairment.
For the knowledge/attitude questions, the proportion of physicians who answered correctly on each statement was first calculated. Since the total number of correct responses for each physician is a count variable, a poisson regression . The independent variables in the model included physician gender, years of experience, palliative care training received and country of basic medical training.
For the best-worst scaling exercise, we calculated an importance score  for each role by subtracting the number of times each role was chosen as being ‘least important’ from the number of times it was chosen as being ‘most important’. As each role appears 4 times in the design, the possible values of these best-worst (B-W) scores at the individual level ranged from −4 to 4. These scores were then rescaled to range between 0 and 1. These importance scores are known to be highly collinear with the estimates from a conventional multinomial logistic regression or conditional logistic regression choice model .
Physician demographics are presented in Table 2. The majority (66 %) received no additional training in palliative care beyond their basic medical school training.
Figure 1 shows the variation in proportions of physicians recommending life-extending treatment for each attribute level (predicted at the mean of the other levels). We found that treatment recommendations varied widely for any given patient profile unless the patient was assumed to have cognitive impairment. 73 % of physicians recommended life extending treatment for patients in the best-case scenario that consisted of a 35 year old patient, where treatment would extend life by 24 months, 5-year survival rate was 10 % and treatment cost was $10,000. In contrast, 40 % of physicians recommended treatment (and 60 % did not) in the worst case (i.e., oldest patient, highest treatment cost, worst prognosis) scenario that consisted of a 75 year old patient, where treatment would extend life by 4 months, 5-year survival rate was 1 % and treatment cost was $100,000.
We also find some variation in treatment recommendations by age, treatment costs and prognosis even for patients with moderate to severe cognitive impairment, with only 18 % of the physicians recommending treatment in the best-case scenario and 8 % recommending treatment in the worst-case scenario.
Results from logistic regression (Table 3) show that physicians are more likely to recommend life-extending treatments to patients who are younger, have a better prognosis, and if treatment costs are lower. Furthermore, physicians with more years of experience were more likely to recommend life-extending treatment to patients without cognitive impairment, but were less likely to recommend treatments to patients with cognitive impairment. Physicians, trained in Europe, North America, Australia and New Zealand, were more likely to recommend life-extending treatment to patients with cognitive impairment compared to those trained in Singapore.
Results of the questions (Table 4) show that the percent of correct answers ranged from 51 to 92 %. The statement assessing prescription of a strong opioid for severe pain as soon as it is detected had the fewest correct responses (51 %). Results from the Poisson regression showed that physicians with greater years of experience (β = 0.02; p-value = 0.03), those trained in Europe, North America, Australia, or New Zealand (versus those trained in Singapore; β = 0.67; p-value = 0.001) and those with additional training in palliative care (versus those with no additional training; β = 0.47; p-value = 0.045) had a greater number of correct responses.
The importance scores from the best-worst exercise showed that contrary to our hypothesis, the most important perceived role in treating a patient at the EOL was treating pain and other physical symptoms, which was rated most important 84 % of the times it appeared. On the other hand, the three least important roles perceived by the physicians were withholding diagnosis/prognosis, extending patient’s life for as long as possible and discussing treatment costs (Fig. 2).
Results show considerable variation in physician recommendations for EOL care, some of which can be predicted by physician characteristics. If these results extend to real life, it raises significant concerns as to whether patients are receiving the most appropriate treatment at the EOL. Unfortunately, there are no real world studies that we are aware of to gauge the veracity of the results. Results further show that lack of appropriate knowledge/attitude in some aspects of palliative care, reinforcing the need to focus on palliative care education among non-palliative care physicians.
More experienced physicians were more likely to recommend life-extending treatments to patients without cognitive impairment, possibly due to their greater expertise in use of these treatments. However, with more experience, there is also a realistic appreciation of patient’s prognosis and realization of the apparent futility of such treatments, especially among those with cognitive impairment. Thus experienced physicians become less likely to recommend life-extending treatments to patients with cognitive impairments. Alternatively, this relationship could denote a cohort effect, due to younger physicians being trained in a different medical culture as compared to older physicians. However, physicians trained outside Asia were more likely to recommend these treatments to patients with cognitive impairment. The reason for this is not known. Nevertheless, study results suggest that if all decision making were left to physicians, there would likely be large variation in treatment recommendations even for similarly situated patients. By eliciting and respecting patient preferences, it may be possible to minimize variations in EOL treatments as a result of differences in physician practice styles or their personal characteristics. Formulation of standards or guidelines for care and their promotion by the government or third party payers, perhaps tied to pricing and reimbursement, may also help to reduce practice variation, as would greater levels of utilization review.
As with our findings, previous studies have also found that patients with dementia are less likely to be treated for cancer [20–23]. With an increase in prevalence of dementia, physicians can expect to face these decisions more frequently. It is unclear whether life-extending treatments offer any survival benefit to patients with moderate to severe cognitive impairment,  and thus it is difficult to define what course of treatment will achieve the best possible medical outcomes for these patients. This is further complicated by the challenge of eliciting patient preferences, as most patients with serious cognitive impairment lack capacity for decision making and even minor diagnostic and treatment procedures may cause significant distress to the patient. Future studies on this topic and development of guidelines for treatment of ASI among patients with cognitive impairment may help physicians provide clearer guidance to caregivers and work to reduce variation in physician recommendations.
Despite some evidence that age per se does not influence the efficacy of many life-extending treatments, [24–26] we find that physicians are more reluctant to recommend these treatments to older patients as compared to younger patients, given the same prognosis and treatment costs. This is consistent with previous literature reporting an age bias in physician recommendation of cancer treatments and life-sustaining treatments [27, 28]. It may be that older patients are at a greater risk of adverse drug reactions,  that physicians believe that older patients may not want as much life-extending treatment because of fatalist attitudes, or because physicians themselves attach lower value to extending life in an older patient compared to a younger patient. Therefore, efforts should be made to encourage physicians to discuss patient’s treatment preferences without being biased by their age.
Treatment costs also influence physician treatment recommendations; however, physicians did not seem to view discussing treatment costs with EOL patients as an important role, possibly because they feel that they do not have the skills, knowledge, or time to do so or because they do not see it as their role.
We further show that despite the presence of well-established guidelines regarding treatment of severe pain, only 50 % of the physicians surveyed responded correctly to a statement regarding appropriate opioid prescription. Furthermore, Singapore trained physicians scored lower compared to physicians trained in many other developed countries. Insufficient exposure to palliative care in the undergraduate medical curriculum in Singapore may have contributed to this. Medical students in Singapore receive only 4 days of training in palliative care in their entire undergraduate medical curriculum, as compared to an average of 14 days in United States [10, 30, 31]. Basic palliative care education and training for medical students, residents, and practicing physicians is needed to fill this lacuna, and one needs to look into the best models for incorporating palliative care in training curricula at various levels.
The study has several limitations. First, it is hypothetical and results may not generalize to real patients. There is also a lack of clinical detail upon which to make decisions; more detail may have generated greater consistency. Moreover, despite promising confidentiality, it is possible that physician responses may have been influenced if they felt that they were being evaluated. It is also possible that framing of some of the statements in the best-worst tasks could have influenced physician responses. For instance, the statement ‘extending patient’s life for as long as possible’ is worded quite strongly and as a result could have been consistently underrated by physicians. Further, despite every effort to expand this survey to all major departments in major public hospitals, some of the departments did not allow or did not have time for the study team to present in their department meetings. However, we have no reason to believe these departments would respond differently. Lastly, due to the absence of a sampling frame of physicians, we invited physicians to participate in the survey by advertising in department meetings and through department heads and colleagues. Due to different modalities of invitation and advertisement, it was not possible to calculate how many physicians received the invitation to do the survey and hence the response rate.
Results from this study suggest that variation in physician treatment recommendations may be partly related to their own characteristics. If confirmed, this might raise concerns regarding the EOL care being provided to patients. Efforts should be made to better understand the variation in treatment recommendations for similarly situated patients in specific clinical settings and to provide physicians with additional training in key aspects of palliative care management.
Advanced serious illness
Mercuri M, Gafni A. Medical practice variations: what the literature tells us (or does not) about what are warranted and unwarranted variations. J Eval Clin Pract. 2011;17(4):671–7. doi:10.1111/j.1365-2753.2011.01689.x.
Davis P, Gribben B, Lay-Yee R, Scott A. How much variation in clinical activity is there between general practitioners? A multi-level analysis of decision-making in primary care. J Health Serv Res Policy. 2002;7(4):202–8. doi:10.1258/135581902320432723.
Vincent JL. Forgoing life support in western European intensive care units: the results of an ethical questionnaire. Crit Care Med. 1999;27(8):1626–33.
Fainsinger R, Waller A, Bercovici M, Bengtson K, Landman W, Hosking M, et al. A multicentre international study of sedation for uncontrolled symptoms in terminally ill patients. Palliat Med. 2000;14(4):257–65.
Ball CG, Navsaria P, Kirkpatrick AW, Vercler C, Dixon E, Zink J, et al. The impact of country and culture on end-of-life care for injured patients: results from an international survey. J Trauma Acute Care Surg. 2010;69(6):1323–34.
Raijmakers N, van Zuylen L, Furst C, Beccaro M, Maiorana L, Pilastri P, et al. Variation in medication use in cancer patients at the end of life: a cross-sectional analysis. Support Care Cancer. 2013;21(4):1003–11.
Low JA, Ng WC, Yap KB, Chan KM. End-of-life issues--preferences and choices of a group of elderly Chinese subjects attending a day care centre in Singapore. Ann Acad Med Singap. 2000;29(1):50–6.
Lim MK. Shifting the burden of health care finance: a case study of public-private partnership in Singapore. Health Policy. 2004;69(1):83–92.
Phua J, Kee AC, Tan A, Mukhopadhyay A, See KC, Aung NW, et al. End-of-life care in the general wards of a Singaporean hospital: an Asian perspective. J Palliat Med. 2011;14(12):1296–301. doi:10.1089/jpm.2011.0215.
Lien Centre for Palliative Care. Report of a National Education Needs Assessment of Healthcare Professionals for Palliative Care in Singapore 2014.
Smith TJ, Temin S, Alesi ER, Abernethy AP, Balboni TA, Basch EM, et al. American Society of Clinical Oncology provisional clinical opinion: the integration of palliative care into standard oncology care. J Clin Oncol. 2012;30(8):880–7. doi:10.1200/JCO.2011.38.5161.
Peabody JW, Luck J, Glassman P, Jain S, Hansen J, Spell M, et al. Measuring the quality of physician practice by using clinical vignettes: a prospective validation study. Ann Intern Med. 2004;141(10):771–80.
Peabody JW, Luck J, Glassman P, Dresselhaus TR, Lee M. Comparison of vignettes, standardized patients, and chart abstraction: a prospective validation study of 3 methods for measuring quality. JAMA. 2000;283(13):1715–22.
Sawtooth Software. Sawtooth Software. http://www.sawtoothsoftware.com/. Accessed May 6 2015.
Louviere JJ, Hensher DA, Swait JD. Stated choice methods: analysis and applications. Cambridge University Press; Cambridge, United Kingdom. 2000.
Flynn TN. Valuing citizen and patient preferences in health: recent developments in three types of best-worst scaling. Expert Rev Pharmacoecon Outcomes Res. 2010;10(3):259–67. doi:10.1586/erp.10.29.
Louviere JJ, Flynn TN. Using best-worst scaling choice experiments to measure public perceptions and preferences for healthcare reform in australia. Patient. 2010;3(4):275–83. doi:10.2165/11539660-000000000-00000.
Coxe S, West SG, Aiken LS. The analysis of count data: A gentle introduction to Poisson regression and its alternatives. J Pers Assess. 2009;91(2):121–36.
Gallego G, Bridges JF, Flynn T, Blauvelt BM, Niessen LW. Using best-worst scaling in horizon scanning for hepatocellular carcinoma technologies. Int J Technol Assess Health Care. 2012;28(3):339–46. doi:10.1017/S026646231200027X.
Gorin SS, Heck JE, Albert S, Hershman D. Treatment for breast cancer in patients with Alzheimer’s disease. J Am Geriatr Soc. 2005;53(11):1897–904. doi:10.1111/j.1532-5415.2005.00467.x.
Raji MA, Kuo YF, Freeman JL, Goodwin JS. Effect of a dementia diagnosis on survival of older patients after a diagnosis of breast, colon, or prostate cancer: implications for cancer care. Arch Intern Med. 2008;168(18):2033–40. doi:10.1001/archinte.168.18.2033.
Gupta SK, Lamont EB. Patterns of presentation, diagnosis, and treatment in older patients with colon cancer and comorbid dementia. J Am Geriatr Soc. 2004;52(10):1681–7. doi:10.1111/j.1532-5415.2004.52461.x.
Robb C, Boulware D, Overcash J, Extermann M. Patterns of care and survival in cancer patients with cognitive impairment. Crit Rev Oncol Hematol. 2010;74(3):218–24. doi:10.1016/j.critrevonc.2009.07.002.
Bakogeorgos M, Mountzios G, Kotsantis G, Economopoulou P, Fytrakis N, Kentepozidis N. Chemotherapy compliance, tolerance and efficacy in elderly and non-elderly patients with metastatic colorectal cancer: a single institution comparative study. J BUON. 2013;18(3):629–34.
Jehn CF, Böning L, Kröning H, Pezzutto A, Lüftner D. Influence of comorbidity, age and performance status on treatment efficacy and safety of cetuximab plus irinotecan in irinotecan-refractory elderly patients with metastatic colorectal cancer. European Journal of Cancer.50(7):1269–75. doi:10.1016/j.ejca.2014.01.005.
Evans JG. Aging and rationing. BMJ. 1991;303(6807):869–70.
Newcomb PA, Carbone PP. Cancer treatment and age: patient perspectives. J Natl Cancer Inst. 1993;85(19):1580–4.
Hamel MB, Teno JM, Goldman L, Lynn J, Davis RB, Galanos AN, et al. Patient age and decisions to withhold life-sustaining treatments from seriously ill, hospitalized adults. SUPPORT Investigators. Study to Understand Prognoses and Preferences for Outcomes and Risks of Treatment. Ann Intern Med. 1999;130(2):116–25.
Hubbard RE, O’Mahony MS, Woodhouse KW. Medication prescribing in frail older people. Eur J Clin Pharmacol. 2013;69(3):319–26. doi:10.1007/s00228-012-1387-2.
Dickinson GE. A quarter century of end-of-life issues in U.S. medical schools. Death Stud. 2002;26(8):635–46. doi:10.1080/07481180290088347.
Case AA, Orrange SM, Weissman DE. Palliative medicine physician education in the United States: a historical review. J Palliat Med. 2013;16(3):230–6. doi:10.1089/jpm.2012.0436.
This study was funded by Lien Centre for Palliative Care and National University Cancer Institute, Singapore Endowment fund.
The authors declare that they have no competing interests.
CM and EAF conceptualized the study. NC, JZ and HBD participated in acquisition of data and designing the survey questionnaire. All authors contributed to interpretation of data, drafting of manuscript and revising it critically. All authors read and approved the final manuscript.
About this article
Cite this article
Malhotra, C., Chan, N., Zhou, J. et al. Variation in physician recommendations, knowledge and perceived roles regarding provision of end-of-life care. BMC Palliat Care 14, 52 (2015). https://doi.org/10.1186/s12904-015-0050-y
- Terminal care
- Treatment recommendations
- Palliative care
- Pain management
- Perceived roles
- Best-worst scaling