Towards a standardized method of developing quality indicators for palliative care: protocol of the Quality indicators for Palliative Care (Q-PAC) study
© Leemans et al; licensee BioMed Central Ltd. 2013
Received: 28 September 2012
Accepted: 6 February 2013
Published: 8 February 2013
In recent years, there have been several studies, using a wide variety of methods, aimed at developing quality indicators for palliative care. In this Quality Indicators for Palliative Care study (Q-PAC study) we have applied a scientifically rigorous method to develop a comprehensive and valid quality indicator set which can contribute to a standardized method for use in other countries.
Methods and design
Firstly, an extensive literature review identified existing international quality indicators and relevant themes for measuring quality in palliative care. Secondly, the most relevant of these were selected by an expert panel. Thirdly, those prioritized by the experts were scored by a second multidisciplinary expert panel for usability and relevance, in keeping with the RAND/UCLA-method, combining evidence with consensus among stakeholders. This panel included carers and policymakers as well as patients and next-of-kin. Fourthly, the draft set was tested and evaluated in practice for usability and feasibility; the indicators were then translated into questionnaires presented to patients, next-of-kin and care providers. To encourage the acceptance and use of the indicators, stakeholders, including national palliative care organizations, were involved throughout the whole project.
Our indicator development trajectory resulted in a set of quality indicators applicable to all patients in all palliative care settings. The set includes patient and relative perspectives and includes outcome, process and structure indicators. Our method can contribute internationally to a more standardized and rigorous approach to developing quality indicators for palliative care.
KeywordsQuality indicators Quality measurement Palliative care Quality of care End of life care Hospice care Outcome measures Developing method
Quality of care is of interest to everyone receiving or providing palliative care . Evaluation of quality informs care providers, administrators and policymakers about whether patients and their families are receiving care that fits their needs [2–4]. The challenge for quality improvement in palliative care is to develop effective ways for the quick and efficient assessment of service performance and outcomes, as this facilitates the modification of services and practices in order to improve the quality of care at individual and institutional levels [5–8]. For this purpose, quality indicators specifically for palliative care can be used to address issues unique to this type of care .
Although in the past decade a variety of studies have focused on quality indicators for palliative care, the methods found in the literature by which indicators were developed were not always clearly presented and not always seemed to follow a systematic approach involving different steps of the development process [10–26]. Two recent systematic efforts have developed a nationwide quality register system to measure outcomes and quality of palliative care services: the Palliative Care Outcomes Collaboration (PCOC)-study in Australia , and a similar registration project in Sweden . While these projects have resulted in very useful national quality monitoring systems, they do not strictly make use of quality indicators but mainly focus on outcome measures. Additionally they did not seem to aim for a level of comprehensiveness necessary to evaluate the various dimensions of palliative care.
Definitions and examples of outcome measures, quality indicators and quality measurement instruments
Outcome measure/ variable
Quality measurement instrument
An essential component of quality whereby the focus lies on patient’s or relatives outcomes, measured at an individual level.
Well defined and measurable aspect of care, generally expressed in a number or percentage, addressing a specific aspect of care or a related outcome. Quality indicators are usually expressed on aggregated level.
Instruments that can be used to monitor quality of care.
Concerns outcomes of care
Concerns structure, process or outcomes of care
Concerns structure, process or outcomes of care
In palliative care, outcome measures provide a way to evaluate patient- and family-level status and response to treatment for symptoms and conditions in physical, psychological and other domains
Clinically relevant, manageable and based on existing evidence, or if not applicable on consensus
These instruments are used to measure outcome measures on individual level as well as quality indicators on aggregated level Individual and aggregated level
Contains standardized specifications detailing the eligible population, data collection procedures and types of analyses needed to calculate the indicator
Percentage of patients with moderate to severe pain 
Numerated rating scales (NRS)
Quality of life Comfort
Extent to which patients indicate that caregivers respect their life stance 
McGill Quality of Life Questionnaire 
Patient’s appraisal of the quality of care Relative’s appraisal of the quality of care
Extent to which direct relatives felt supported by the caregivers immediately after the patient’s death 
Following the model proposed by Donabedian, quality indicators should be monitored in all three major areas of health care: structure, process and outcome . Structure refers to the organization of care (eg presence of a written policy about visiting patients in the ICU), whereas process refers to the interaction between providers and receivers of care (eg psychosocial support being offered within the first 72 hours of admission to the ICU) . Outcomes of care are at the level of the beneficiary of that care (eg adequate treatment of pain) .
With good examples of systematic and scientifically rigorous development trajectories for quality indicators for palliative care lacking in the literature, we intend this article to contribute to the establishment of a scientifically rigorous standardized and applicable method of measuring usable quality indicators. We do this by describing the protocol of a study developing a quality indicators set for palliative care for adults in Flanders (the Flemish speaking part of Belgium), applicable in all settings providing palliative care, thus providing an example usable by other countries interested in monitoring the quality of palliative care.
Methods and design
Phase 1: identification of existing quality indicators
To get an overview of previous attempts to develop quality indicators for palliative care, a thorough systematic literature review was performed, building on a review done in 2007 by Pasman et al . With the field of quality indicators and the literature on quality measurements in palliative care developing quickly, it was important to update the existing review using the same method and search strategies but including the most recent literature published between December 2007 and May 2009.
As in the original review, we searched four international databases (Pubmed, PsychINFO, EMBASE and CINAHL). Two independent reviewers (KL and JC) followed the same procedures as in the original review by Pasman et al (results of this review update are integrated into a paper published in Journal of Pain and Symptom Management ).
Phase 2: identifying domains and themes of quality palliative care
Selected domains for the quality of palliative care in Flanders
Physical treatment and care
Psychological, social and existential treatment and care
Information, communication, planning and decision making with the patient
Information, communication, planning and decision making with the family
Information, communication, planning and decision making with other caregivers
Type of care at the end of life
Coordination and continuity of care
Support of family and informal caregivers
Structure of care
Example of themes within domains: Domain 1 ‘Physical treatment and care’
Process of care
To measure or evaluate general symptom burden
To measure or evaluate pain
To measure or evaluate nausea and problems with digestion
To measure or evaluate fatigue and insomnia
To measure or evaluate decubitus
To measure or evaluate appetite
To measure or evaluate problems with respiration/tightness of the chest
To measure or evaluate delirium
To measure or evaluate complaints on the mouth
To treat or care for physical symptoms once observed with the patient
Mentioning in the patient’s file the presence of symptoms
Mentioning in the patient’s file the offered treatment and/or medication for the purpose of physical problems
Mentioning in the patient’s file the result of the offered treatment and/or medication for the purpose of physical problems
Outcome of care
Low general symptom burden
Absence of pain
Absence of problems with respiration/ tightness of the chest
Absence of delirium
Absence of decubitus
Absence of fatigue and insomnia
Absence of complaints of the mouth
Absence of nausea and problems with digestion
A good appetite
In order to select the themes most important to quality palliative care we held a consultation of experts representing all relevant actors in palliative care, including patient and family perspectives. The panel consisted of nurses and other caregivers from all different specialized palliative care services, physicians from different specialities, coordinators of the Flemish Palliative Care networks, volunteers, spiritual and religous counsellors, bereaved family members and representatives of palliative patients i.e. large patient organisations such as the Flemish Cancer League and the Flemish Advisory Board for the Elderly.
The panel was asked to score each theme, as identified through the literature, on a scale from 1 (least important) to 5 (most important). Additionally we asked them to select the three most important themes per domain (questionnaires available upon request). Per domain themes were ranked from most important to least important based on the mean scores and the frequency with which the theme was indicated as most important within the domain. Based on the mean scoring (highest tertile across all domains) a number of themes were selected. To be selected, there had to be consensus among the panel members for each indicator, i.e. not more than four members scoring outside the mean range [1–9]. With every domain not then represented, we included one additional theme most often indicated as one of the three most important themes within the domains that were underrepresented. We choose to preserve the nine domains because the research team decided that all domains should be covered in order to have a comprehensive set. Additionally, experts were able to identify additional themes that did not come out of the literature review in a separate box for each domain and these were added if consensus among the experts was reached (i.e. more than one expert added this theme).
Phase 3: indicator selection by expert consultation
The selected themes were then translated into quality indicators (i.e. with standardized specifications detailing the eligible population, data collection procedures, numerator and denominator), using the quality indicators found in the systematic literature review in the first phase. Then a second consecutive multidisciplinary palliative care expert panel was organized for another selection round. This panel, like the first panel, consisted of researchers in quality measurement or in palliative care, nurses and other caregivers in the field of palliative care, caregivers with a policy task in palliative care, bereaved family members and patient representatives. The experts could add quality indicators important to them not presented in the list and could discard those they found less important. For social and existential aspects of care, no indicators were found in the literature so experts were asked to suggest well-defined and measurable quality indicators for further development.
Comprehensive literature review on the topic (i.e. systematic literature review in phase 1) and recommendation of a preliminary set of quality indicators within the quality framework obtained through the first expert panel.
Recruiting expert clinicians from professional organisations reflecting the variety of specialities in palliative care and inviting them to join a panel for a two-stage process to rate the validity of the indicators. These experts included a representative from a patient organisation and a next-of-kin (eg partner, relative or friend most closely involved), as in the first panel round.
Sending the draft indicators by post to the panel members, who rated the indicators in terms of appropriateness and relevance as measures of quality on a scale from 1 (not appropriate or not necessary) to 9 (very appropriate or very necessary) (questionnaires available upon request).
Feeding back first-round scores to the panellists for a second round of scoring in a face-to-face panel meeting. Only indicators with a median score of 4, 5, 6 or higher but not reaching consensus were discussed, modified where necessary and rescored. The indicators with a median score of 7, 8 or 9 were automatically added to the quality indicator set and modified where necessary by the researchers.
Using the second-round scores to select only those indicators rated highly for validity and on which panel members had reached consensus. Indicators rated low or not reaching consensus among panellists were discarded.
After this second face-to-face consultation a draft set of quality indicators was produced (Figure 1).
Phase 4: Developing and testing the draft quality indicator set in palliative practice
The next challenge was to test the draft indicator set in palliative care practice, in particular in order to assess its usability and feasibility (eg work load). Up until now, the draft set had been based on literature and expert opinion and hence needed operationalization and validation in practice, after which final adjustments could be made.
Distribution between observational units and study units during the testing phase
Care for the patient
Care for the next of kin
Process of care
Structure of care
The questionnaires were divided over the observational units via four different palliative care services (representing all the different palliative care services in Flanders): the palliative home care team, the palliative care unit, the palliative support team in the hospital and the care home (only residents for whom a ‘palliative trajectory’ was initiated). A selection of services was recruited via the existing palliative care networks in Flanders: a call was sent out by the coordinators of these networks and services could volunteer to participate. After recruitment, a contact person for each service was appointed to organize the mailing of the questionnaires together with a researcher from the research team. The intention was to capture a cross section of the quality of palliative care in the different services at a particular moment, so one interrogation only was conducted. This demanded that a random selection was made of patients receiving palliative care services as well of those who had received palliative care services and had died between six weeks and six months earlier; a representative snapshot of the quality of existing care was thus created, taking into account coincidental patient mix confounders. With the quality of care susceptible to change over time, such a snapshot forms a basic starting point. The choice of a single measurement also makes the measurement of quality less burdensome for staff.
Four different types of questionnaire (available upon request), each measuring different quality indicators, were sent:
For adult patients currently receiving palliative care
For next-of-kin involved in the care of a patient who had died six weeks to six months previously
For the central formal care provider (a nurse in the palliative home care team and in the care home and a nurse or a physician in the palliative support team and the palliative care unit) about the care of a patient currently receiving palliative care
For general practitioner of patients who had died in the previous six weeks to six months
A maximum of 10 questionnaires was sent to any one nurse or physician.
We were able to list which patients, care providers and next-of-kin had already participated by the identifier numbers on the returned questionnaires attributed to each selected patient at the time of inclusion. In collaboration with the coordinator of each service involved, reminders were sent: one to patients and next-of-kin and up to two to care providers. As the researchers have not disposed of the list with patient, caregiver and family member contact details, identifying individuals through the identifier numbers on the questionnaires was not possible. After the reminders were sent and the questionnaires returned the collected data was analysed and quality indicators were calculated for each participating service.
The testing phase was then evaluated in terms of feasibility and usability. First telephone interviews with non-responding family members and family physicians were held to assess reasons for non-participation. This was done by a third independent party in order to preserve anonymity of patients and family members from the researchers. The contact person of the palliative service communicated the phone numbers of family and physicians directly to this independent person by email, based on the identifier numbers received by the researchers. Furthermore interviews were conducted with all coordinators and contact persons to evaluate the usability of the indicators and the procedure. Before the start of the interview all contact persons were asked to question the other caregivers about their experiences with the testing and the length of the questionnaire(s) they completed.
Based on the results of the test in terms of usability and feasibility, the indicator set, questionnaires and manual were adapted in order to be ready for use by the palliative services independently. We evaluated the instrument combining qualitative interviews with the caregivers involved about the workload and future use of the set and of quantitative psychometric analyses of the dataset gathered (e.g. number of missing answers per indicator). Furthermore, on request of the field, the indicator set was divided into a required minimal data set with complementary modules, each set usable separately or combined by the palliative services interested in quality measurement and improvement.
This article presents a method followed in Flanders (the Flemish speaking part of Belgium) for developing quality indicators for palliative care. The method comprises four phases: 1) a literature review identifying existing quality indicators, 2) a literature review and expert consultation to identify the important themes and domains for quality palliative care, 3) quality indicator selection by expert consultation following the internationally validated RAND method and 4) testing the draft quality indicator set in practice. This four-phase method combines the different phases from previous development processes in other countries (ie literature review, expert consultation, practical test) and additionally includes patient and next-of-kin perspectives, structure, process and outcome indicators and applicability to all patients in all palliative care services.
The method developed here can contribute to the development of a standardized and functional set of quality indicators for palliative care in other countries as it meets the standards of scientific rigour and the level of comprehensiveness required.
Choosing a multi phased method leading to comprehensiveness
An important strength of the quality indicators development method described here is that it contains several phases to make the quality indicator set as comprehensive as possible, i.e. measuring quality of care for all adult palliative patients and across all domains relevant to palliative care. By combining a literature review on quality indicators with the building of a framework on important themes in palliative care, all aspects of palliative care have been taken into account. Previous sets of quality indicators for palliative care have tended to target specific populations such as cancer patients or vulnerable older people [9, 16, 18, 46–48]. Our set, like that developed in the Netherlands is characterized by applicability to all setting and to all adult patient groups receiving palliative care  making it possible in the future, after assessing case mix adjusters, to compare scores of quality indicators not only over different disciplines but over different care settings.
Choosing a combination of evidence through literature review and expert consultation
As the thinking about quality indicators and the literature about quality of palliative care is developing quickly, it is necessary to review the field regularly, especially when beginning to develop a new set of quality indicators. In the literature we found researchers developing quality indicators who had not performed such a review but had started from an existing quality indicator set such as Saliba et al.  who had selected indicators feasible for nursing home quality assessment from the original ACOVE quality indicator set. This raises the question of whether completely new indicators need to be developed for a particular country or whether existing indicators can be adjusted and validated in a set for that country . Either way, a literature review can help to reveal existing indicators for further development and quality monitoring in any country.
Consultation of experts in palliative care in order to select the most important elements and indicators for measuring quality is a key element in the methodology described here and scoring by experts is important in assessing the validity and usefulness of the proposed indicators. Additionally it has the advantage that consultation of relevant palliative care actors enhances the acceptance and face-validity of the resulting indicator set among the palliative care community . The composition of the panel should reflect all relevant actors within palliative care: those in medical practice and palliative care, policymakers, researchers, patient representatives and family. The latter two categories are often forgotten in quality indicator development but are essential to the creation of a comprehensive set of quality indicators reflecting all perspectives in palliative practice. The expert consultation can best be done by the RAND/UCLA-method .
Choosing inclusion of outcome, process and structure indicators and involvement from all perspectives
Although measuring structure and process indicators from medical charts or administrative databases may be easier and cheaper, using only such sources for quality measurements may cause problems. Such databases can be limited, especially where indicators depend on precise documentation of issues such as communication, patient-reported outcomes or preferences ; such information can only be obtained from patients and their families themselves. On the other hand some researchers and care providers tend to see quality only through the perspective of the patient. This perspective does indeed provide the best indication of whether good quality care has been achieved , but data for calculating have to be derived from individual care users which, apart from the practical issues, also limits the possibility of measuring all relevant aspects of the quality of palliative care which might be susceptible to improvement. Therefore many authors [9, 29, 35, 38, 39, 49] suggest that a quality indicator set, in order to be broad and comprehensive, must include structure and process as well as outcome indicators. We chose to translate our draft indicator set into questionnaires for the different respondent groups, patients, family and care providers, depending on which we considered would be the most reliable raters for selected quality indicators. Other quality researchers have based their evaluation of usability and feasibility on abstraction from patient records [11, 14, 23, 25], thereby automatically limiting the comprehensiveness of an indicator set.
Choosing a manageable testing of the quality indicator set
A crucial stage in the development process is the testing and evaluation of the set for usability and feasibility (eg work load) in practice; before it can be taken up on a nationwide scale the set needs operationalization and validation in palliative practice. Because of its extensive character, we felt it necessary to perform this testing phase in a small sample of palliative care service organisations.
To stimulate acceptance and use of quality indicators, stakeholders from palliative practice should be involved as early as possible in the development process. In Flanders we also collaborated closely with the Flemish Federation for Palliative Care, which helped to promote the project and enhance participation from care providers.
Work in progress
The quality indicator set for palliative care for adults in Flanders is now fully developed and ready to be used in practice to monitor quality of palliative care. Before scores of quality indicators can be validly compared across different services and care providers, however, significant case mix adjusters and the discriminative power of the indicators need to be assessed. Only if future research in a larger sample confirms the discriminative power of the indicators can they be recommended for comparative information or benchmarking  while benchmarking itself can only be made possible by implementing the quality indicator set on a large scale in Flanders.
A standardized method for the development of quality indicators for palliative care can also offer opportunities on the international level; providing internationally comparable data .
There is an increasing recognition of the need for quality indicators for palliative care in order to develop quality programmes across countries and to provide evidence to policymakers about the quality of the palliative care they are providing. However, a standardized method of developing quality indicators for palliative care has been lacking. In this paper we propose a method which meets the required level of scientific rigour and creates a sound basis for achieving the comprehensiveness needed in a set of quality indicators. The method suggested here combines standard literature analyses with multidisciplinary expert consultations involving all relevant actors within palliative care, following the RAND/UCLA-method, the only validated systematic method for quality indicator selection. Those wanting to develop indicators in other countries can use this standardized method to further develop and validate quality indicators for palliative care.
Acknowledgements and funding
We thank the Flemish Federation of Palliative Care for their support in the project. We also thank our experts for their time and excellent work. We thank Jane Ruthven for her language editing. The draft indicator set for palliative care in Flanders is available upon request from the authors. This study is part of the ‘Flanders Study to Improve End-of-Life Care and Evaluation Tools (FLIECE-project)’, a collaboration between the Vrije Universiteit Brussel, Ghent University, the Katholieke Universiteit Leuven, Belgium, and VU University Medical Centre Amsterdam, the Netherlands. This study is supported by a grant from the Flemish government agency for Innovation by Science and Technology (agentschap voor Innovatie door Wetenschap en Technologie) (SBO IWT nr. 100036). Joachim Cohen and Lieve Van den Block are postdoctoral fellows of the Science Foundation Flanders.
- Emanuel EJ, Emanuel LL: The promise of a good death. Lancet. 1998, 351( (2): SII21-SII29.View ArticleGoogle Scholar
- Singer PA, Martin DK, Kelner M: Quality end-of-life care: patients' perspectives. JAMA. 1999, 281 (2): 163-8.View ArticlePubMedGoogle Scholar
- Steinhauser KE, Clipp EC, McNeilly M: In search of a good death: observations of patients, families, and providers. Ann Intern Med. 2000, 132 (10): 825-32.View ArticlePubMedGoogle Scholar
- Teno JM, Casey VA, Welch LC, Edgman-Levitan S: Patient-focused, family-centered end-of-life medical care: views of the guidelines and bereaved family members. J Pain Symptom Manage. 2001, 22 (3): 738-51.View ArticlePubMedGoogle Scholar
- Bowman KW, Martin DK, Singer PA: Quality end-of-life care. J Eval Clin Pract. 2000, 6 (1): 51-61.View ArticlePubMedGoogle Scholar
- Campbell SM, Roland MO, Buetow SA: Defining quality of care. Soc Sci Med. 2000, 51 (11): 1611-25.View ArticlePubMedGoogle Scholar
- Lorenz KA, Lynn J, Dy SM: Evidence for improving palliative care at the end of life: a systematic review. Ann Intern Med. 2008, 148 (2): 147-59.View ArticlePubMedGoogle Scholar
- Rosenfeld K, Wenger NS: Measuring quality in end-of-life care. Clin Geriatr Med. 2000, 16 (2): 387-400.View ArticlePubMedGoogle Scholar
- Seow H, Snyder CF, Mularski RA: A framework for assessing quality indicators for cancer care at the end of life. J Pain Symptom Manage. 2009, 38 (6): 903-12.View ArticlePubMedGoogle Scholar
- Claessen SJ, Francke AL, Belarbi HE: A new set of quality indicators for palliative care: process and results of the development trajectory. J Pain Symptom Manage. 2011, 42 (2): 169-82.View ArticlePubMedGoogle Scholar
- Dy SM, Lorenz KA, O'Neill SM: Cancer Quality-ASSIST supportive oncology quality indicator set: feasibility, reliability, and validity testing. Cancer. 2010, 116 (13): 3267-75.View ArticlePubMedGoogle Scholar
- Earle CC, Park ER, Lai B: Identifying potential indicators of the quality of end-of-life cancer care from administrative data. J Clin Oncol. 2003, 21 (6): 1133-8.View ArticlePubMedGoogle Scholar
- Earle CC, Neville BA, Landrum MB: Evaluating claims-based indicators of the intensity of end-of-life cancer care. Int J Qual Health Care. 2005, 17 (6): 505-9.View ArticlePubMedGoogle Scholar
- Grunfeld E, Lethbridge L, Dewar R: Towards using administrative databases to measure population-based indicators of quality of end-of-life care: testing the methodology. Palliat Med. 2006, 20 (8): 769-77.View ArticlePubMedPubMed CentralGoogle Scholar
- Grunfeld E, Urquhart R, Mykhalovskiy E: Toward population-based indicators of quality end-of-life care: testing stakeholder agreement. Cancer. 2008, 112 (10): 2301-8.View ArticlePubMedPubMed CentralGoogle Scholar
- Lorenz KA, Rosenfeld K, Wenger N: Quality indicators for palliative and end-of-life care in vulnerable elders. J Am Geriatr Soc. 2007, 55 (Suppl 2): S318-S326.View ArticlePubMedGoogle Scholar
- Lorenz KA, Dy SM, Naeim A: Quality measures for supportive cancer care: the Cancer Quality-ASSIST Project. J Pain Symptom Manage. 2009, 37 (6): 943-64.View ArticlePubMedGoogle Scholar
- Miyashita M, Morita T, Ichikawa T: Quality indicators of end-of-life cancer care from the bereaved family members' perspective in Japan. J Pain Symptom Manage. 2009, 37 (6): 1019-26.View ArticlePubMedGoogle Scholar
- Mularski RA, Curtis JR, Billings JA: Proposed quality measures for palliative care in the critically ill: a consensus from the Robert Wood Johnson Foundation Critical Care Workgroup. Crit Care Med. 2006, 34 (11): S404-S411.View ArticlePubMedGoogle Scholar
- National Quality Forum: National voluntary consensus standards for symptom management and end-of-life care in cancer patients. 2006, Washington DC: National Quality ForumGoogle Scholar
- Pastrana T, Radbruch L, Nauck F: Outcome indicators in palliative care-how to assess quality and success, Focus group and nominal group technique in Germany. Support Care Cancer. 2009, 18 (7): 859-868.View ArticlePubMedPubMed CentralGoogle Scholar
- Saliba D, Solomon D, Rubenstein L: Feasibility of quality indicators for the management of geriatric syndromes in nursing home residents. J Am Med Dir Assoc. 2004, 5 (5): 310-9.View ArticlePubMedGoogle Scholar
- Sato K, Miyashita M, Morita T: Reliability assessment and findings of a newly developed quality measurement instrument: quality indicators of end-of-life cancer care from medical chart review at a Japanese regional cancer center. J Palliat Med. 2008, 11 (5): 729-37.View ArticlePubMedGoogle Scholar
- Schenck AP, Rokoske FS, Durham DD, Cagle JG, Hanson LC: The PEACE Project: identification of quality measures for hospice and palliative care. J Palliat Med. 2010, 13 (12): 1451-9.View ArticlePubMedGoogle Scholar
- Twaddle ML, Maxwell TL, Cassel JB: Palliative Care Benchmarks from Academic Medical Centers. J Palliat Med. 2007, 10 (1): 86-98.View ArticlePubMedGoogle Scholar
- Yabroff KR, Mandelblatt JS, Ingham J: The quality of medical care at the end-of-life in the USA: existing barriers and examples of process and outcome measures. Palliat Med. 2004, 18 (3): 202-16.View ArticlePubMedGoogle Scholar
- Eagar K, Watters P, Currow DC, Aoun SM, Yates P: The Australian Palliative Care Outcomes Collaboration (PCOC) measuring the quality and outcomes of palliative care on a routine basis. Aust Health Rev. 2010, 34 (2): 186-92.View ArticlePubMedGoogle Scholar
- Lundstrom S, Axelsson B, Heedman PA, Fransson G, Furst CJ: Developing a national quality register in end-of-life care: The Swedish experience. Palliat Med. 2012, 26 (4): 313-21.View ArticlePubMedGoogle Scholar
- Campbell SM, Braspenning J, Hutchinson A, Marshall MN: Research methods used in developing and applying quality indicators in primary care. BMJ. 2003, 326 (7393): 816-9.View ArticlePubMedPubMed CentralGoogle Scholar
- Ostgathe C, Voltz R: Quality indicators in end-of-life care. Curr Opin Support Palliat Care. 2010, 4 (3): 170-3.View ArticlePubMedGoogle Scholar
- Shekelle PG, Maclean CH, Morton SC, Wenger NS: Assessing care of vulnerable elders: methods for developing quality indicators. Ann Intern Med. 2001, 135 (8): 647-52. Pt 2View ArticlePubMedGoogle Scholar
- Singer PA, Martin DK, Bowman K: Quality end-of-life care: where do we go from here?. J Palliat Med. 2000, 3 (4): 403-5.View ArticlePubMedGoogle Scholar
- Bausewein C, Simon ST, Benalia H: Implementing patient reported outcome measures (PROMs) in palliative care users' cry for help. Health Qual Life Outcomes. 2011, 9: 27.View ArticlePubMedPubMed CentralGoogle Scholar
- Mularski RA, Dy SM, Shugarman LR: A systematic review of measures of end-of-life care and its outcomes. Health Serv Res. 2007, 42 (5): 1848-70.View ArticlePubMedPubMed CentralGoogle Scholar
- Donabedian A: Quality assurance: structure, process and outcome. Nurs Stand. 1992, 7 (11): 4-5.View ArticlePubMedGoogle Scholar
- Pasman HR, Brandt HE, Deliens L, Francke AL: Quality indicators for palliative care: a systematic review. J Pain Symptom Manage. 2009, 38 (1): 145-56.View ArticlePubMedGoogle Scholar
- De Roo M, Leemans K, Claessen SJ: Quality indicators for palliative care: update of a systematic review. J Pain Symptom Manage. 2013, In pressGoogle Scholar
- Ferrell F: Overview of the domains of variables relevant to end-of-life care. J Palliat Med. 2005, 8: 22-9.View ArticleGoogle Scholar
- Stewart AL, Teno J, Patrick DL, Lynn J: The concept of quality of life of dying persons in the context of health care. J Pain Symptom Manage. 1999, 17 (2): 93-108.View ArticlePubMedGoogle Scholar
- Teno JM, Clarridge B, Casey V, Edgman-Levitan S, Fowler J: Validation of Toolkit After-Death Bereaved Family Member Interview. J Pain Symptom Manage. 2001, 22 (3): 752-8.View ArticlePubMedGoogle Scholar
- Fitch K, Bernstein S, Aguilar M, Burnand B, LaCalle J, Lazaro P: The RAND/UCLA Appropriateness Method User's Manual. 2001, Santa Monica, CA: RAND CorporationGoogle Scholar
- van der Ploeg E, Depla MF, Shekelle P, Rigter H, Mackenbach JP: Developing quality indicators for general practice care for vulnerable elders; transfer from US to The Netherlands. Qual Saf Health Care. 2008, 17 (4): 291-5.View ArticlePubMedGoogle Scholar
- Addington-Hall J: VOICES (Vieuws of INformal Carers - Evaluation of Services. 1998, London: King's College School of Medicine and DentistryGoogle Scholar
- Addington-Hall J, Karlsen S: Care for the Dying in Cornwall: A Survey of Bereaved Relatives. Final Report. 1999, London: Department of Palliative Care and PolicyGoogle Scholar
- Cohen SR, Mount BM, Bruera E: Validity of the McGill Quality of Life Questionnaire in the palliative care setting: a multi-centre Canadian study demonstrating the importance of the existential domain. Palliat Med. 1997, 11 (1): 3-20.View ArticlePubMedGoogle Scholar
- Lorenz KA, Lynn J, Dy S: Quality measures for symptoms and advance care planning in cancer: a systematic review. J Clin Oncol. 2006, 24 (30): 4933-8.View ArticlePubMedGoogle Scholar
- Seow H, Snyder CF, Shugarman LR: Developing quality indicators for cancer end-of-life care: proceedings from a national symposium. Cancer. 2009, 115 (17): 3820-9.View ArticlePubMedGoogle Scholar
- Wenger NS, Rosenfeld K: Quality indicators for end-of-life care in vulnerable elders. Ann Intern Med. 2001, 135 (8): 677-85. Pt 2View ArticlePubMedGoogle Scholar
- Donaldson MS, Field M: Measuring quality of care at the end of life. Arch Intern Med. 1998, 158 (2): 121-8.View ArticlePubMedGoogle Scholar
- Casarett DJ, Teno J, Higginson I: How Should Nations Measure the Quality of End- of-Life Care for Older Adults? Recommendations for an International Minimum Data Set. J Am Geriatr Soc. 2006, 54 (11): 1765-71.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-684X/12/6/prepub