Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Improving palliative care in selected settings in England using quality indicators: a realist evaluation

BMC Palliative Care volume 15, Article number: 69 (2016) Cite this article

Abstract

Background

There is a gap between readily available evidence of best practice and its use in everyday palliative care. The IMPACT study evaluated the potential of facilitated use of Quality Indicators as tools to improve palliative care in different settings in England.

Methods

1) Modelling palliative care services and selecting a set of Quality Indicators to form the core of an intervention, 2) Case studies of intervention using the Quality Indicator set supported by an expert in service change in selected settings (general practice, community palliative care teams, care homes, hospital wards, in-patient hospices) with a before-and-after evaluation, and 3) realist evaluation of processes and outcomes across settings. Participants in each setting were supported to identify no more than three Quality Indicators to work on over an eight-month period in 2013/2014.

Results

General practices could not be recruited to the study. Care homes were recruited but not retained. Hospital wards were recruited and retained, and using the Quality Indicator (QI) set achieved some of their desired changes. Hospices and community palliative care teams were able to use the QI set to achieve almost all their desired changes, and develop plans for quality improvements. Improvements included: increasing the utility of electronic medical records, writing a manual for end of life care, establishing working relationships with a hospice; standardising information transfer between settings, holding regular multi-disciplinary team meetings, exploration of family carers’ views and experiences; developing referral criteria, and improvement of information transfer at patient discharge to home or to hospital.

Realist evaluation suggested that: 1) uptake and use of QIs are determined by organisational orientation towards continuous improvement; 2) the perceived value of a QI package was not powerful enough for GPs and care homes to commit to or sustain involvement; 3) the QI set may have been to narrow in focus, or more specialist than generalist; and 4) the greater the settings’ ‘top-down’ engagement with this change project, the more problematic was its implementation.

Conclusions

Whilst use of QIs may facilitate improvements in specialist palliative care services, different QI sets may be needed for generalist care settings.

Peer Review reports

Background

The science of clinical decision-making is well developed but the science of the delivery of care is relatively new and unfamiliar to most health professionals [1]. As a consequence there are gaps between available evidence of best practice and its application in everyday care, across all disciplines within health care [2]. This includes palliative care [3, 4], which aims to “improve the quality of life of patients and families who face life-threatening illness, by providing pain and symptom relief, spiritual and psychosocial support from diagnosis to the end of life and bereavement” [5].

The ageing of the population and the longer survival of people with life-threatening conditions have resulted in rising demand for palliative care from patients with multiple and complex problems [6, 7]. For example, in Europe within the next decade the incidence and prevalence of cancers will increase by about 20 % whilst the prevalence of dementia is expected to double before 2050 [8, 9]. Meeting the palliative care needs of this growing population is a big task, since the aim is to optimise the quality of life of people who have complex, incurable and life-threatening health problems by addressing their physical, emotional, psychosocial and spiritual needs.

Palliative care for people with cancer is relatively well developed, in terms of its conceptual framework and evidence base [10]. The evidence base to guide practice with those dying with complex non-cancer conditions (for example, dementia) is less well developed, although now evolving [11]. The organisation of palliative care has been described extensively [12–14], but it is not clear how best to improve its quality, especially for non-cancer conditions.

Quality Indicators (QIs) can be used to assess where care can be improved. Campbell et al, [15], following Danabedian [16], describe QIs as evidence-based, explicitly defined and measurable items that evaluate and describe the structure, processes and outcomes of health care, and that can indicate problems in achievement of good quality care. They can be used to assess and feed back to professionals their actual performance against benchmarks, as a starting point for quality improvement [17]. QIs have been used effectively to assess and improve hospital care [18], primary care [19], and dementia care [20]. Several international studies have also developed QIs to improve the structures and process needed for the delivery of good quality palliative cancer and dementia care [21–23]. However, these indicator sets have not yet been widely applied in everyday clinical practice. This study developed and implemented a QI package to improve the organisation of palliative care in five European countries [24]. This paper describes the experiences of using a QI set to improve palliative care in different settings in one of the five countries, England.

Methods

Aim

The IMPACT project (IMplementation of Quality Indicators in PAlliative Care sTudy, 2011 to 2015) aimed to evaluate the potential of QIs as tools to improve palliative care for people with cancer or dementia in five European sites (England, Germany, Italy, Norway, and The Netherlands). We adopted Batalden and Davidoff’s definition of quality improvement [25] as “combined and unceasing efforts… to make changes that will lead to better patient outcomes (health), better system performance (care) and better professional development (learning)”.

Study design

Evaluating the effect of QIs required research methods that were able to respond to the many factors that shape palliative care in general and its organisational processes in particular. Controlling these aspects in an international study with strict deadlines made a randomised controlled trial (RCT) impractical [26, 27]. RCTs of services are usually focused on one setting and often in one country, while this study explored and initiated QIs in several settings in multiple European countries with varying health care systems. A before-and-after (pre-test, post-test) design was used instead.

The stepwise development of the QI set for this study was informed by the UK Medical Research Council (MRC) framework for the development and evaluation of complex interventions to improve health [28] and guidance for applying research findings to end of life care [29]. Table 1 shows the intervention development tasks that were included in the IMPACT project; these included modelling the landscape of palliative care [30], identification of barriers to change [31], design of the evaluation study [32], achievement of expert consensus on QIs, [33], and clarification of commonalities and differences in palliative care by disease [34].

Table 1 Tasks of the IMPACT project
Full size table

Ethical considerations

This study invited health and care professionals to participate in a quality improvement process, and those who participated were asked to give their written consent. Medical or care records were assessed by the health care professionals in the settings themselves. No patient data were recorded or used in a way that would allow the identity of patients to be recognised. The research team had an agreed protocol for responding to any potentially poor practice that they encountered.

Theory and modelling

A qualitative description of palliative care models in Europe informed both the development of strategies to improve the organisation of palliative care using QIs. The QIs were derived from existing indicator sets and selected using a modified RAND Delphi procedure [35] involving a mix of clinicians and researchers active in palliative care [32].

The final set of 32 QIs used in the intervention study referred to: access to palliative care (specialist services, out of hours care, continuity of care), infrastructure of palliative care, assessment tools used by practitioners, personnel providing palliative care services (disciplines, teamwork, sharing information), documentation of clinical data, quality of care and its measurement, and education about palliative care.

Additional file 1 provides an overview of the quality indicators.

As an example of how these Qis were operationalised, the QIs on access to specialist palliative care services include the following questions:

  • QI 1: Is a specialist palliative care team available 24 h/day, 7 days a week (24/7)?

  • QI 2: Is specialist palliative care advice available 24/7?

  • QI 3: Are bereaved relatives and/or professionals offered support during the bereavement process?

Full details of the development of the complete QI set are reported in van Riet Paap et al [33]. The present paper focuses on the application of the QI set in different settings in England, and the evaluation of the project.

The strategies to improve the organisation of palliative care were identified in an integrative review [36] that drew on both empirical and theoretical literature on implementation strategies [37]. Subsequently, interviews and focus group interviews with health and care professionals were used to adjust the strategies to national and setting-specific circumstances, in order to develop a toolkit of country- and setting-specific strategies to improve the organisation of palliative care.

Intervention

We know that using feedback alone results in small to moderate effects on service performance [38]. In addition to individualised feedback, this study also used other strategies tailored to influence setting-specific barriers and facilitators, to promote change. These included educational interventions (didactic, experiential, mentoring), process mapping, feedback on performance using audit data, multi-disciplinary case discussions and multi-component approaches [33]. Many of these strategies have been tested before [1, 39], but not yet in the complex multidimensional field of palliative care. Quality Indicators and improvement strategies were developed for four types of settings (hospitals, care homes, hospices and community palliative care teams); no strategies were developed for general practice because of the failure to recruit interested practices. Settings which opted to participate did so on the understanding that the Quality Indicator set would be used as a formative rather than summative tool; that is, the purpose of using QIs was not to reach a judgement about the quality of the service provided, but to allow participants to identify, reflect on and work on weaknesses in their service, as they perceived them.

Setting and participants

The IMPACT team included members of the pan-European research group on detection and timely INTERvention in DEMentia (INTERDEM) and of the European Association of Palliative Care (EAPC), who used their research networks to purposefully select sites to take part in the intervention. Sites were excluded from participation in the study if they did not treat palliative patients aged 18 years or above, or if they had not provided any palliative care for the previous three years. Within these services, health and social care professionals were invited to participate in the pre-test –post-test study. Figure 1 shows the flow of the IMPACT pre-test, post-test study.

Fig. 1
figure 1

Flow chart of the pre-test, post-test study

Full size image

Implementation

In the pre-test audit phase the QI set was discussed with professionals working in each setting to profile the palliative care services provided in each setting, and subsequently to identify aspects in their service that required improvement. At the launch meeting (see Fig. 1) a project lead for the site was selected. The project lead arranged the pre-test audit of the site’s palliative care services using the QI set. A web-based data registration system (Lime survey: www.limesurvey.org/) was used to capture answers about the use of QIs, allowing early comparison of data between settings and providing rapid feedback to participants. With feedback from the research team based on their responses, professionals in each site were then encouraged to set improvement objectives formulated in a SMART way (Specific, Measurable, Acceptable, Realistic and Timely) [40]. A consultant with expertise in service development helped each site to start and finish structured improvement projects [41]. In the intervention phase each site’s professionals then chose specific strategies, tailored to their situation, to improve the organisation of palliative care. After the intervention period (post-test phase), the palliative care service was re-assessed with the use of the same QI set.

Evaluation and dissemination

A process evaluation was performed to study barriers and facilitators of the implementation process during the intervention period [42]. This process evaluation included an activity report which both the health and care professionals involved in the study and the consultant and researcher working with the site were asked to complete. These reports captured details of what was going to plan, what was not, and any barriers and facilitators facing the teams. To derive a deeper understanding of the barriers mentioned in these activity reports, semi-structured interviews were conducted among the professionals who participated in the implementation process at the end of the implementation period. In addition, field notes were kept by all researchers and consultants after each encounter at the implementation site, whether face-to-face, by telephone or by email.

To get a better understanding of the changes in the organisation of palliative care and the experiences of the health care professionals involved in the intervention, the qualitative data were analysed thematically [43]. A realist evaluation approach was used to synthesise the data from interviews, pre and post audits and field notes, in order to obtain a comprehensive picture of the contexts within which palliative care professionals worked, the mechanisms which promoted or impeded changes, and the consequent outcomes for each setting (without describing any outcome as primary or secondary, a priori). Realist evaluation works to the immediate priorities of empirical research, responds to the research brief, deals with the substantive issue and contributes to policy development, rather than aiming for methodological purity [44].

Results

Table 2 shows recruitment and retention of sites in the English arm of the study. General practices could not be recruited to the study despite considerable effort over six months. A variety of approaches was used to recruit including the engagement of palliative care ‘champions’ and focusing upon trainee practitioners and practitioners recommended by palliative care teams and hospices for their interest in the topic.

Table 2 Recruitment and retention of settings in the English arm of the IMPACT study
Full size table

Care homes were recruited but not retained in the study. Three care homes were recruited from one commercial chain, with the support of their senior management, and two agreed to take part in the study. In one care home the manager spoke frankly about her difficulties in engaging the staff in palliative care and welcomed the opportunity to have staff workshops run by IMPACT consultants, but had moved to a different care home before these workshops could begin. In the second care home the manager explained at the launch meeting that it was the home’s policy to avoid providing palliative care to residents, preferring to transfer dying residents to other homes or to hospital. This manager agreed that wider staff use of pain scales would be an appropriate change for the care home to explore, but thereafter did not respond to further contacts with the research team.

Overall the participant sites performed relatively well against the Quality Indicator set. All had access to palliative care expertise outside normal office hours and at weekends, although not necessarily to all disciplines involved in multi-disciplinary palliative care teams. Regular meetings of multi-disciplinary teams occurred at all sites, as did training activities for team members. Medical records were not accessible across organisational boundaries, so those providing end of life care in a hospital setting would not be able to access records held in the nearby but organisationally separate hospice or community palliative care team. All sites provided bereavement support (albeit in different forms) to relatives, and most also offered bereavement support for staff. Opioids and co-analgesics could be obtained when needed. Communication about transfer of patients to other settings was systematised in all sites, using mixtures of written, electronic (email or fax) and verbal (telephone, face-to-face) methods. All sites had access to necessary equipment (drug administration pumps, anti-decubitus mattresses, stoma care supplies etc.) when needed. Single rooms for dying patients were available in all sites, except of course in community services supporting patients in their own homes. Use of standardised instruments (for example, for pain assessment, or assessment of emotional needs) varied considerably between sites. Similar variation was found in the systematic capture of relatives’ experiences of the services, and in use of palliative care guidelines.

Table 3 summarises changes planned in the implementation study in each site: ticks represent achievement of changes, as agreed by the research team and the participants at each site. Using the QI set hospital wards were recruited and retained, and achieved some of their desired changes. Hospices and community palliative care teams were able to achieve almost all their desired changes, and develop plans for future quality improvements. Changes that were not achieved were implementation of validated pain assessment scales and documenting conversations with patients. In all hospital ward, hospices and related community teams the changes pursued after applying the QI package took longer than the study’s six month follow-up period (by up to three months) because of intercurrent problems such as staff changes, funding difficulties and competing organisational demands, delaying data transfer on outcomes to the IMPACT research team.

Table 3 Changes planned in the implementation study in each site
Full size table

Table 4 shows the main headings of the realist evaluation, drawing together the research team’s conclusions on the impact of the contexts and the mechanisms on achievement of outcomes. Important contextual factors with a negative impact were the implementation of the controversial Health & Social Care Act 2012, which redefined the roles of general practitioners (in England) in particular, and the reorganisation of the care home chain involved in the study. The most evident mechanism with a negative impact on outcomes was ‘top down’ decision-making about joining the study; where senior management (in care homes or hospitals) decided to take part in the study, less senior staff resisted involvement.

Table 4 Realist evaluation: conclusions on the impact of the context and the mechanisms on achieving outcomes
Full size table

Discussion

The novel feature of the IMPACT project was the use of a QI set as part of a complex intervention to facilitate improvement in palliative care across a range of settings. The IMPACT QI set was comparable to the EUROPALL Quality Indicators [45] but more organisational and less clinical than those reviewed by Lorenz and colleagues [46].

The stepwise implementation used in this study enabled us to tailor the intervention at a setting and country level and so to translate the intervention into everyday clinical practice [12]. It followed the Batalden and Davidoff model of change, beginning with the generalisable scientific evidence that was applied in known contexts to give measureable performance improvements [22]. The realist evaluation focussed on developing explanatory models, using multiple data sources and methods, and sought to investigate contexts, mechanisms and outcomes in specific configurations [35].

Uptake and implementation of changes in organisation and practice identified using the QI set varied across settings, with maximal impact on in-patient hospices and community palliative care teams, and no impact in general practice or care homes. Although claims have been made that palliative care is the “territory” [47] of generalists the failure to engage general practices in the study is not surprising. The context (major recent changes in the British National Health Service across healthcare delviery and in general practice in particular, lack of funding for GPs to carry out palliative care) added to the known difficulties that GPs have in caring for dying patients [48], the challenge of maintaining palliative care skills [49], and the persistent taboo about discussing death [50].

Two objectives were not reached by any of the hospices and community paliative care teams: documentation of discussions with family carers; and routine use of validated pain assessment tools. Our impression is that the former had low priority compared with other communication tasks, such as transfering information if the patient moved settings. Pain management, of which formalised assessment tools are an important part, remains a problem in palliative care [51], and our participants’ inability to achieve their intended goal reflects this.

Realist evaluation suggested that four factors operated in the English sites:

  1. 1)

    uptake and use of QIs was determined by a history of organisational orientation towards continuous improvement, described by Flottorp and colleagues as “capacity for organisational change” [52];

  2. 2)

    the perceived value of the QI package offered was not powerful enough for GPs and care homes to commit to or sustain involvement, given their contexts;

  3. 3)

    the QI set may have been too specialist (in palliative care terms) in its focus and not useful enough for non-specialists (in care homes and in general practice) and;

  4. 4)

    the greater the settings’ ‘top-down’ engagement with this change project, the more problematic was its implementation.

These conclusions are consistent with Berwick’s view that any complex multi-component intervention is essentially a process of social change that is in turn influenced by leadership, changing environments, details of the implementation and organisational history [53]. It is also consistent with the argument that mechanisms are usually hidden and sensitive to variations in context [54].

The findings of this study should be treated cautiously. Althought case studies yield important lessons about service changes in complex organisational environments, and are therefore very appropriate to palliative care [55], their generalisability may by limited by their close attention to contexts. Before-and-after studies tend to over-estimate effect sizes [56], although this probably applies more to quantitative outcomes than to organisational processes, and realist evaluation has methodological problems that may limit its potential [57]. More involvement of generalists in the development of the QI set, with public and patient involvement too, might have resulted in a QI set that was more applicable to general practice and care homes.

Conclusions

Nevertheless, the findings of this study can contribute to the further evolution of palliative care, as well as indicating where further research and development efforts are needed. For example, findings from the IMPACT project informed the European Declaration on Palliative Care in 2014 (www.palliativecare2020.eu/declaration/). In our view a single, generic QI set is unlikely to serve the needs of different settings, and further work is needed to find levers for change in general practice and care homes. Even in hospices and community palliative care teams the implementation of a QI set seemed to depend on the pre-existing research and development culture of the organisation. A range of methods for engaging services with less developed cultures is needed [58], especially if palliative care expertise is to be made available in England to those with non-cancer conditions, as will be recommended by the forthcoming NICE guidance (http://www.nice.org.uk/guidance/indevelopment/gid-cgwave0694)

Abbreviations

EUROPALL, European Palliative care study; IMPACT, IMplementation of Quality Indicators in PAlliative Care sTudy; INTERDEM, interventions in dementia research group; MRC, Medical Research Council; NRES, National Research Ethics Service; QI, quality indicator; RCT, Randomised controlled trial; SMART, specific, measurable, acceptable, realistic and timely.

References

  1. Marshall M, Mountford J. Developing a science of improvement. J Royal Soc Med. 2013;106:45–50.

    Article  Google Scholar 

  2. Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients’ care. Lancet. 2003;362:1225–30.

    Article  PubMed  Google Scholar 

  3. Sachs GA, Shega JW, Cox-Hayley D. Barriers to excellent end-of-life care for patients with dementia. J Gen Intern Med. 2004;19:1057–63.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Vissers KC, van den Brand MW, Jacobs J, Groot M, Veldhoven C, Verhagen C, Hasselaar J, Engels Y. Palliative medicine update: a multidisciplinary approach. Pain Pract. 2013;13:576–88.

    Article  PubMed  Google Scholar 

  5. WHO definition Palliative Care [URL: http://www.who.int/cancer/palliative/en/] Accessed 29/07/15.

  6. Ouwens M, Wollersheim H, Hermens R, Hulscher M, Grol R. Integrated care programmes for chronically ill patients: a review of systematic reviews. Int J Qual Health Care. 2005;17:141–6.

    Article  PubMed  Google Scholar 

  7. Lynn J, Adamsom D. Living Well at the End of Life: Adapting Health Care to Serious Chronic Illness in Old Age. Rand Health White Paper WP137 edition. 2003.

    Google Scholar 

  8. van den Beuken-van Everdingen MH, de Rijke JM, Kessels AG, Schouten HC, van Kleef M, Patijn J. High prevalence of pain in patients with cancer in a large population-based study in The Netherlands. Pain. 2007;132:312–20.

    Article  PubMed  Google Scholar 

  9. EuroCode. Dementia in Europe Yearbook 2008. Luxembourg: Alzheimer Europe; 2008.

    Google Scholar 

  10. Ahmedzai S, Costa A, Blengini C, Bosch A, San-Ortiz J, Ventafridda V, et al. A new international framework for palliative care. Eur J Cancer. 2004;40:2192–200.

    Article  CAS  PubMed  Google Scholar 

  11. van der Steen J. Dying with dementia: what we know after more than a decade of research. J Alzheimer’s Disease. 2010;22:37–55.

    Google Scholar 

  12. Radbruch L, Payne S. White paper on standards and norms for hospice and palliative care in Europe: part 1. Eur J Palliat Care. 2009;16:278–89.

    Google Scholar 

  13. Radbruch L, Payne S. White paper on standards and norms for hospice and palliative care in Europe: part 2. Eur J Palliat Care. 2010;17:22–33.

    Google Scholar 

  14. Centeno C, Clark D, Lynch T, Racafort J, Praill D, De Lima L, Greenwood A, Flores LA, Brasch S, Giordano A. Facts and indicators on palliative care development in 52 countries of the WHO European region: results of an EAPC Task Force. Palliat Med. 2007;21:463–71.

    Article  PubMed  Google Scholar 

  15. Campbell SM, Braspenning J, Hutchinson A, Marshall MN. Research methods used in developing and applying quality indicators in primary care. BMJ. 2003;326:816–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  16. Donabedian A. The quality of care: How can it be assessed? JAMA. 1988;121(11):1145–50.

    Google Scholar 

  17. Grol R, Wensing M, Eccles MP. Improving patient care: the implementation of change in clinical practice. Edingburg: Elsevier; 2005.

    Google Scholar 

  18. de Vos M, Graafmans W, Kooistra M, Meijboom B, Van Der Voort P, Westert G. Using quality indicators to improve hospital care: a review of the literature. Int J Qual Health Care. 2009;21:119–29.

    Article  PubMed  Google Scholar 

  19. Engels Y, Dautzenberg M, Campbell S, Broge B, Boffin N, Marshall M, Elwyn G, Vodopivec-Jamsek V, Gerlach FM, Samuelson M, Grol R. Testing a European set of indicators for the evaluation of the management of primary care practices. Fam Pract. 2006;23:137–47.

    Article  PubMed  Google Scholar 

  20. Draskovic I, Vernooij-Dassen M, Verhey F, Scheltens P, Rikkert MO. Development of quality indicators for memory clinics. Int J Geriatr Psychiatry. 2008;23:119–28.

    Article  PubMed  Google Scholar 

  21. Pasman HR, Brandt HE, Deliens L, Francke AL. Quality indicators for palliative care: a systematic review. J Pain Symptom Manage. 2009;38:145–56.

    Article  PubMed  Google Scholar 

  22. Claessen SJ, Francke AL, Belarbi HE, Pasman HR, van der Putten MJ, Deliens L. A new set of quality indicators for palliative care: process and results of the development trajectory. J Pain Symptom Manage. 2011;42:169–82.

    Article  PubMed  Google Scholar 

  23. Woitha K, Van Beek K, Ahmed N, Hasselaar J, Mollard JM, Colombet I, Radbruch L, Vissers K, Engels Y. Development of a set of process and structure indicators for palliative care: the Europall project. BMC Health Serv Res. 2012;12:381.

    Article  PubMed  PubMed Central  Google Scholar 

  24. van Riet PJ, Vernooij-Dassen M, Brouwer F, Meiland F, Iliffe S, Davies N, Leppert W, Jaspers B, Mariani E, Sommerbakk R, Vissers K, Engels Y, on behalf of the IMPACT team. Improving the organization of palliative care: identification of barriers and facilitators in five European countries. Implement Sci. 2014;9:130. doi:10.1186/s13012-014-0130-z.

    Article  Google Scholar 

  25. Batalden PB, Davidoff F. What is ‘quality improvement’ and how can it transform healthcare? Qual Saf Health Care. 2007;16:2–3.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Carlson MD, Morrison RS. User’s guide to research in palliative care: why is a new series needed? J Palliat Med. 2008;11:1258–61.

    Article  PubMed  PubMed Central  Google Scholar 

  27. McKee M, Britton A, Black N, McPherson K, Sanderson C, Bain C. Methods in health services research. Interpreting the evidence: choosing between randomised and non-randomised studies. BMJ. 1999;319:312–5.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  28. Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, Guthrie B, Lester H, Wilson P, Kinmonth AL. Designing and evaluating complex interventions to improve health care. BMJ. 2007;334:455–9.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Evans C, Stone K, Manthorpe J, Higginson I. MRC Guidance on Developing and Evaluating Complex Interventions: Application to Research on Palliative and End of Life Care, SSCR Methods Review 15, NIHR School for Social Care Research, London. 2014. [URL: http://www.sscr.nihr.ac.uk/PDF/MR/MR15.pdf] Accessed 29/07/15.

  30. Iliffe S, Davies N, Vernooij-Dassen M, van Riet PJ, Sommerbakk R, Mariani E, Jaspers B, Radbruch L, Manthorpe J, Maio L, Engels Y, for the IMPACT research team. Modelling the landscape of palliative care for people with dementia: a European mixed methods study. BMC Palliat Care. 2013;12(1):30.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Davies N, Maio L, Vedavanam K, Manthorpe J, Vernooij-Dassen M, Iliffe S, for the IMPACT research team. Barriers to the provision of high quality palliative care for people with dementia in England: A qualitative study. Health Soc Care Community. 2014;22(4):386–94.

    Article  PubMed  Google Scholar 

  32. van Riet PJ, Engels Y, Iliffe S, Radbruch L, Kaasa S, Chattat R, Vissers K, Vernooij-Dassen M. Improving the organisation of palliative care by implementing quality indicators and national and setting-specific interventions: study protocol of the IMPACT project. Prog Palliat Care. 2014;22(4):201–5.

    Article  Google Scholar 

  33. van Riet PJ, Vernooij-Dassen M, Dröes RM, Radbruch L, Vissers K, Engels Y, IMPACT research team. Consensus on quality indicators to assess the organisation of palliative cancer and dementia care applicable across national healthcare systems and selected by international experts. BMC Health Serv Res. 2014;14:396.

    Article  Google Scholar 

  34. Davies N, Maio L, Van-Riet-Paap J, Mariani E, Jaspers B, Sommerbakk R, Gramatico D, Manthorpe J, Ahmedzai S, Vernooij-Dassen M, Iliffe S, for the IMPACT research team. Quality Palliative Care across Europe for Cancer and Dementia: some common challenges. Aging Ment Health. 2014;18(4):400–10.

    Article  PubMed  Google Scholar 

  35. Fitch K, Bernstein SJ, Aguilar MD, Burnand B, LaCalle JR, Lázaro P, van het Loo M, McDonnell J, Vader JP, Kahan JP. The RAND/UCLA Appropriateness Method User’s Manual. Santa Monica: RAND; 2001.

    Google Scholar 

  36. Whittemore R, Knafl K. The integrative review: updated methodology. J Adv Nurs. 2005;52:546–53.

    Article  PubMed  Google Scholar 

  37. van Riet PJ, Vernooij-Dassen M, Sommerbakk R, Moyle W, Hjermstad MJ, Leppert W, Vissers K, Engels Y, IMPACT research team. Implementation of improvement strategies in palliative care: an integrative review. Implement Sci. 2015;10(1):103.

    Article  Google Scholar 

  38. Jamtvedt G, Young JM, Kristoffersen DT, O'Brien MA, Oxman AD. Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2006;2:CD000259.

  39. Grol R. Improving the quality of medical care: building bridges among professional pride, payer profit, and patient satisfaction. JAMA. 2001;286:2578–85.

    Article  CAS  PubMed  Google Scholar 

  40. Doran GT. There’s a S.M.A.R.T. way to write management’s goals and objectives. Manage Rev (AMA FORUM). 1981;70(11):35–6.

    Google Scholar 

  41. Engels Y, van den Hombergh P, Mokkink H, van den Hoogen H, van den Bosch W, Grol R. The effects of a team-based continuous quality improvement intervention on the management of primary care: a randomised controlled trial. Br J Gen Pract. 2006;56:781–7.

    PubMed  PubMed Central  Google Scholar 

  42. Hulscher ME, Laurant MG, Grol RP. Process evaluation on quality improvement interventions. Qual Saf Health Care. 2003;12:40–6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  43. Lewin S, Glenton C, Oxman AD. Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. BMJ. 2009;339:b3496.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Pawson R, Manzano-Santaella A. A “realist diagnostic workshop”. Evaluation. 2012;18(2):176–91.

    Article  Google Scholar 

  45. Woitha K, van Beek K, Ahmed N, Jaspers B, Mollard JM, Ahmedzai S, Hasselaar J, Menten J, Vissers K, Engels Y. Validation of quality indicators for the organisation of palliative care: a modified RAND Delphi study in seven European countries (the Europall project). Palliat Med. 2013;0(0):1–9.

    Google Scholar 

  46. Lorenz KA, Rosenfeld K, Wenger N. Quality indicators for palliative and end-of-life care in vulnerable elders. JAGS. 2007;55:S18–36.

    Article  Google Scholar 

  47. Fordham S, Dowrick C, May C. Palliative medicine: is it really specialist territory? J Royal Soc Med. 1998;91:568–72.

    CAS  Google Scholar 

  48. Mitchell GK. How well do general practitioners deliver palliative care? A Syst Rev Palliat Med. 2002;16:457–64.

    Article  Google Scholar 

  49. Shipman C, Gysels M, White P, Worth A, Murray SA, Shepherd J, et al. Improving generalist end of life care: national consultation with practitioners, commissioners, academics and service user groups. BMJ. 2008;537:e1720.

    Article  Google Scholar 

  50. Wise J. Dying remains a taboo subject for patients and GPs, finds survey. BMJ. 2012;344:e3356.

    Article  PubMed  Google Scholar 

  51. Payne S, Leget C, Peruselli C, Radbruch L. Quality indicators for palliative care: debates and dilemmas. Palliat Med. 2012;26(5):679–80.

    Article  PubMed  Google Scholar 

  52. Flottorp SA, Oxman AD, Krause J, Musila NR, Wensing M, Godycki-Cwirko, Baker R, Eccles MP. A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci. 2013;8:35.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Berwick DM. The science of improvement. JAMA. 2008;299(10):1182–4.

    Article  CAS  PubMed  Google Scholar 

  54. Astbury B, Leeuw FL. Unpacking Black Boxes: mechanisms and theory building in Evaluation. Am J Evaluation. 2010;31(3):363–81.

    Article  Google Scholar 

  55. Walshe CE, Caress AL, Todd CJ. Case studies: a research strategy appropriate for palliative care? Palliat Med. 2004;18:677–84.

    Article  PubMed  Google Scholar 

  56. Cabana MD, Wachter RM. The hazards of drawing conclusions from before-and-after studies of system level interventions. Arch Pediatr Adolesc Med. 2011;165(5):472–3.

    Article  PubMed  Google Scholar 

  57. Marchal B, van Belle S, van Olmen J, Hoeree T, Kegels G. Is realist evaluation keeping its promise? A review of published empirical studies in the field of health systems research. Evaluation. 2012;18:192.

    Article  Google Scholar 

  58. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, Procter EK, Kirchner JE. A refining compilation of implementation strategies: results from the Expert recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10:21.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The views and opinions expressed here are those of the authors and do not necessarily reflect those of the European Union, the NIHR, the NHS or the English Department of Health. We thank all those who took part in the IMPACT project in England for their support, and members of the wider project team, including Jane Wilcock, who assisted with the research and evaluated the process and likelihood of sustainability of the adopted measures.

Funding

This project was funded by the European Union’s Seventh Framework Programme FP7/2007-2013 under grant agreement n°258883. Additional support was given by the Clinical Research Networks of the UK National Institute for Health Research (NIHR).

Availability of data and material

Contact the corresponding author.

Authors’ contributions

SI, SA & JM helped develop the project and gain funding; MV-D & YE co-ordinated the IMPACT project; ND, SI & PC contributed to data gathering and analysis at the English sites. All authors have contributed to drafting this paper. All authors read and approved the final manuscript.

Competing interests

The authors declare that there have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

Ethics approval for the study, including obtaining participants’ informed consent, was granted by NRES Committee London (London Bridge) Reference 13/LO/0359.

Author information

Authors and Affiliations

  1. Research Department of Primary Care & Population Health, University College London, Royal Free Campus, Rowland Hill Street, London, NW3 2PF, UK

    Steve Iliffe, Nathan Davies & Peter Crome

  2. Social Care Workforce Research Unit, King’s College London, Strand, London, WC2B 6NR, UK

    Jill Manthorpe

  3. Department of Oncology and Metabolism, School of Medicine and Biomedical Science, The University of Sheffield, Sheffield, S10 2RX, UK

    Sam H Ahmedzai

  4. Scientific Institute for Quality of Healthcare, Radboud University Medical Centre, 6500 HB, Nijmegen, The Netherlands

    Myrra Vernooij-Dassen & Yvonne Engels

Authors
  1. Steve Iliffe
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nathan Davies
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jill Manthorpe
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Peter Crome
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Sam H Ahmedzai
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Myrra Vernooij-Dassen
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Yvonne Engels
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Steve Iliffe.

Additional file

Additional file 1:

Overview of IMPACT Quality Indicators. (DOCX 18 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Iliffe, S., Davies, N., Manthorpe, J. et al. Improving palliative care in selected settings in England using quality indicators: a realist evaluation. BMC Palliat Care 15, 69 (2016). https://doi.org/10.1186/s12904-016-0144-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12904-016-0144-1

Keywords

BMC Palliative Care

ISSN: 1472-684X

Contact us