Skip to main content

Patients’ perceptions of palliative care: adaptation of the Quality from the Patient’s Perspective instrument for use in palliative care, and description of patients’ perceptions of care received

Abstract

Background

Instruments specific to palliative care tend to measure care quality from relative perspectives or have insufficient theoretical foundation. The instrument Quality from the Patient’s Perspective (QPP) is based on a model for care quality derived from patients’ perceptions of care, although it has not been psychometrically evaluated for use in palliative care. The aim of this study was to adapt the QPP for use in palliative care contexts, and to describe patients’ perceptions of the care quality in terms of the subjective importance of the care aspects and the perceptions of the care received.

Method

A cross-sectional study was conducted between November 2013 and December 2014 which included 191 patients (73 % response rate) in late palliative phase at hospice inpatient units, hospice day-care units, wards in nursing homes that specialized in palliative care and homecare districts, all in Norway. An explorative factor analysis using principal component analysis, including data from 184 patients, was performed for psychometric evaluation. Internal consistency was assessed by Cronbach’s alpha and paired t-tests were used to describe patients’ perceptions of their care.

Results

The QPP instrument was adapted for palliative care in four steps: (1) selecting items from the QPP, (2) modifying items and (3) constructing new items to the palliative care setting, and (4) a pilot evaluation. QPP instrument specific to palliative care (QPP-PC) consists of 51 items and 12 factors with an eigenvalue ≥1.0, and showed a stable factor solution that explained 68.25 % of the total variance. The reliability coefficients were acceptable for most factors (0.79–0.96). Patients scored most aspects of care related to both subjective importance and actual care received as high. Areas for improvement were symptom relief, participation, continuity, and planning and cooperation.

Conclusion

The QPP-PC is based on a theoretical model of quality of care, and has its roots in patients’ perspectives. The instrument was developed and psychometrically evaluated in a sample of Norwegian patients with various diagnoses receiving palliative care in different care contexts. The evaluation of the QPP-PC shows promising results, although it needs to be further validated and tested in other contexts and countries.

Peer Review reports

Background

Patients with life-threatening illnesses and in need of palliative care may have cancer or non-cancer illnesses [1]. The structure of palliative care for these patients may differ between countries [2]. In Norway they receive help from a public healthcare system that has specialized and non-specialized services in palliative care [2], in either community care or specialist healthcare contexts [3]. Community care serves patients at home, via home care or their general practitioner (GP), and patients in nursing homes. Specialist healthcare serves patients in hospitals and specialist services. Hospice care may be part of community care or specialist healthcare [4], and offers specialized inpatient care and day-care services.

The need to have knowledge and evaluate the quality of palliative care is recognized both internationally and in Norway [46]. Patients’ perceptions of their care may be seen as one aspect of quality of care [7, 8] and is considered important for development and improvement of palliative care [5, 6, 811]. To gain such knowledge, validated instruments are needed, which should be tested in different settings and on patients with different illnesses [12, 13].

Previous instruments have measured quality in palliative care, often from the perspectives of the relatives, e.g. FAMCARE [14], Views Of Informal Carers – Evaluation of Services (VOICES) [15] and Care Evaluation Scale (CES) [16]. Although some of these instruments have been modified and used to measure patients’ perspectives of care [1719], instruments derived from patients’ perspectives are available, e.g. the Canadian Health Care Evaluation Project (CANHELP) that measure satisfaction of various aspects of palliative care [20], the Quality of end-of-life care (QEOLC) [21], and the Quality of end-of-life care and satisfaction with treatment quality-of-care scale (QUEST) [22]. The last two measure parts of palliative care; physicians’ skills and interaction with healthcare personnel.

The advantage of using existing instruments to measure patients’ perspectives of palliative care quality is that they have been developed within a palliative care context, including patients’ views in the development process. The importance of instruments with a foundation of a theoretical model of care quality that is based on patients’ perspectives and conceptions of the area can be found in the literature [23], and ensures the measurement of all important aspects of care quality from the patients’ perspectives. However, there is a lack of instruments explicitly founded on a theoretical model of care quality from patients’ perspectives.

The Quality from the Patient’s Perspective (QPP) instrument is based on a theoretical model of quality of care from the patient’s perspective [24]. It was developed from interviews with patients using a grounded theory approach, and the instrument was psychometrically tested using factor analysis [25], and further validated by a dimensional analysis of all items using structural equation modelling [26]. A short version of the QPP has been validated [27], frequently used and psychometrically tested in several contexts [28, 29]. In addition, a modified version of the short version has been developed for advanced home care, a palliative homecare service connected to a palliative medicine unit, which provides qualified medical care in the context of the patients’ homes [30].

From this model, quality of care can be understood in the light of two conditions: the resource structure of the care organization, consisting of person-related, physical and administrative environmental qualities, and patients’ preferences, consisting of human and rational aspects [24]. In this framework, the QPP instrument measures patients’ perceptions of quality of care via items related to four dimensions: the medical–technical competence of the care givers, the degree of identity orientation in the attitudes and activities of the caregivers, the physical–technical conditions of the care organization and its sociocultural atmosphere [24]. Patients evaluate the quality of care in two ways: how they perceive the reality of the quality of care (PR) and the subjective importance of the various aspects of care (SI).

Although the QPP is based on a theoretical model derived from patients’ perspectives and was previously modified and used in palliative home care [30, 31], it has not undergone a psychometric evaluation in palliative care, and does not adequately address all aspects identified as important to patients receiving palliative care [32]. Further development and psychometric evaluation of QPP for a palliative care context are needed.

The aim of this study was to: (1) adapt the QPP for use in palliative care contexts, and (2) describe patients’ perceptions of the care quality in terms of the subjective importance of the care aspects and the perceptions of the care received.

Methods

Settings and participants

Data for this cross-sectional study were collected between November 2013 and December 2014, in two hospice inpatient units (H), two hospice day care units (HD), two wards in nursing homes that specialized in palliative care (NH) and two homecare districts (HC), all in Norway. Six of the settings were specialized (H, HD and NH) and two were non-specialized in palliative care (HC). The settings represented rural and urban locations in the eastern part of Norway.

Patients were consecutively recruited when they met the following inclusion criteria: adult, no cognitive impairment (which was judged by the responsible registered nurse [RN]), understand Norwegian, receive assistance from the services for at least 3 days, have malignant or non-malignant advanced, life-threatening illness in a late palliative phase (as judged by the responsible RN) and guided by a nurse’s negative response to the question: ‘Would you be surprised if this patient dies within the next year?’ [33] (this was judged by the responsible RN). Eligible patients should be included in a palliative care service or, if not, there should be documentation in the patients’ charts indicating that they were in a late palliative phase. The patients’ physicians and one of the researchers (TS) were consulted when uncertainties arose about the inclusion criteria. In addition, eligible patients should be personally aware that they were in a palliative phase (having a life-threatening illness) and that they received palliative care (as judged by the responsible RN).

The instrument was delivered to 262 patients and 191 participated by returning it (response rate = 73 %). Those who did not respond (n = 71) did not differ significantly from the responding group with regard to age (P = 0.569) or gender (P = 0.117).

Measures

QPP is an instrument developed to measure the quality of care from the patients’ perspectives [2527]. In this study, a QPP instrument specific to palliative care (QPP-PC) was adapted to measure quality of care from the perspectives of patients with different life-threatening illnesses in diverse palliative care settings. Modifications of the QPP items and development of new items were mainly based on a review of the literature [32] and of symptoms presented in the revised version of the Edmonton Symptom Assessment System (ESAS-r) [34, 35], in addition to the research team’s expert knowledge in the field, based on experience working with patients in palliative phase and by conducting research in the context of palliative care. The process for the adaptation of the QPP instrument to palliative care is presented in the result section.

Administration of the QPP-PC to patients

Administration of the QPP-PC to the patients resulted in 69 items making up the QPP dimensions: medical–technical competence (11 items); identity-oriented approach (20 items); physical–technical conditions (2 items); sociocultural atmosphere (8 items); and, in addition, context-specific items (28 items). Patients answered each item in two ways. First, patients scored their opinions of the quality of actual care received, perceived reality (PR), related to the sentence ‘This is what I experience …’ (e.g. personnel are respectful to me). Then patients scored the subjective importance of care aspects (SI), related to the sentence ‘This is how important this is to me …’ (e.g. personnel are respectful to me). A four-point Likert scale, ranging from 1 (do not agree at all) to 4 (fully agree), was used for PR, and for SI from 1 (of little or no importance) to 4 (of the very highest importance). A non-applicable alternative was available for both responses.

In addition, the questionnaire consisted of 10 background questions.

Procedure and data collection

Patients were asked to participate by the RN who was responsible for each ward and for screening patients. This nurse provided written and oral information about the study; this information explained that participation was voluntary and that patients’ answers were treated confidentially. Patients gave oral and written consent to participate in the study. Patients were offered help from one of the researchers (TS) to complete the questionnaire, with 50 patients receiving such help. The participants were told that they could use as much time as they needed to complete the questionnaire and return it in a sealed envelope.

Ethical approval

The Regional Committee for Medical and Health Research Ethics in South-East Norway (REC) considered that the study could be conducted without any further approval from them (REC no. 2013/865). Therefore the study was reported to the Norwegian Social Science Data Services (NSD no. 34770). Participation of the settings was approved by the head administrators. Permission to use the QPP was obtained from the developer.

Statistical analysis

Data were analysed using IBM SPSS Statistics, version 22. Seven patients were excluded from the statistical analysis due to the proportion of items answered ‘not applicable’ (or missed observations) only made it possible to calculate less than six out of 12 factors (SI and PR) or one out of four dimensions (SI and PR), leaving 184 patients left for statistical analysis. Descriptive statistics were used to examine patients’ characteristics. Paired sample t-tests were used to investigate patients’ perceptions of the care in terms of differences in subjective importance (SI) and perceived reality (PR) [36]. An independent t-test or Pearson χ 2 test was used for drop-out analysis, as appropriate [36].

Exploratory factor analysis (EFA) using principal component analysis (PCA) was chosen for exploration of the underlying structure among the items [36], because the QPP instrument was modified for use in a new context with no assumption of a known hypothesis about the dimensionality of a set of items [36, 37] . Before PCA, the data’s suitability for factor analysis (EFA) was assessed using Bartlett’s test of sphericity, which tests the overall significant differences in the correlation matrix, and the Kaiser–Meyer–Olkin (KMO) test to check that the sample adequacy was appropriate [36, 37] . To guide the extraction of factors, Kaiser’s criterion was used and factors with an eigenvalue ≥1.0 were obtained for further analysis [36]. To give further support to the extraction of factors, varimax rotation methods with Kaiser normalization were used, which assume no correlation of the underlying factors [36], to ascertain how the items correlate with the different components of the quality-of-care construct. Items loading at ≥0.4 were considered as acceptable loadings to the factor [37], and the items were included in the factor where they loaded the highest. Labelling of the factors was based on the content of the items correlating with the factors [37].

Based on the theoretical model underlying the QPP instrument developed from patients’ perceptions of quality of care, a PCA was conducted for SI and PR scales. Ratings from the SI scale are presented since these scores were considered to reflect general values compared with perceived reality scores, which reflect specific conditions of the settings [25].

The reliability was assessed using Cronbach’s α. Cronbach’s α analyses were carried out on dimensions and factor levels of both subscales (PR and SI) and values >0.7 were regarded as desirable [37].

Since QPP-PC was developed to measure the care quality in a number of different settings and for patients with several different illnesses, “not applicable” responses will always be present. For the QPP-PC dimensions and factors, a mean value was calculated based on the individual participant’s response to the remaining items in the respective dimension or factor. These mean values were used in the paired t-tests.

For the PCA, when participants had responded ‘not applicable’ to an item, a mean of the remaining responses in the respective variable substituted the ‘not applicable’ response [38]. Since the ‘not applicable’ response is coded together with missing observations, any missing observation was also substituted by a mean of the remaining responses in the respective variable. The statistical significance was assumed at P-level <0.05.

Results

The adaptation of QPP to palliative care

The adaptation of the QPP instrument to be specific to palliative care was performed in four steps.

First step: selection of existing items

This step comprised selection of QPP items relevant to the palliative care context. They were selected from the short version of the QPP instrument [27, 39] (20 items), the full QPP version (8 items) [25, 26] and a QPP previously modified for advanced home care [30] (personal communications with the author Wilde-Larsson) (7 items), comprising a total of 35 items. Of these, 25 items were taken verbatim or were slightly abbreviated, e.g. the item ‘I receive the best physical care, e.g. help to take care of my personal hygiene’ was abbreviated to ‘I receive the best possible help to take care of my personal hygiene’.

Second step: modification of existing items

Of the 35 original QPP items, 10 were modified to suit the palliative care context better by altering wording, e.g. the item ‘Feeling that the nurses showed interest in my outlook on life [my spiritual needs]’ was modified to ‘The nurses support me in tending to my spiritual and existential needs’. In addition, QPP items about nurses and doctors were modified by adding items to cover multiprofessional staff (labelled ‘other personnel’). This comprised 8 additional items, with a total of 43 items.

Third step: construction of new items

Some 34 new items were then developed to cover palliative-specific aspects of care that were not or were only partly covered by the QPP. These new items included: symptom management of tiredness and depression (2 items); preservation of dignity (3 items); financial concerns (1 item); information about diagnosis and prognosis (2 items); choosing place of care (1 item); practical support (1 item); sufficiency of multiprofessional care (10 items); support, information and participation of the family (4 items); a secure atmosphere (1 item); support from fellow patients (1 item); and continuity, planning and cooperation (8 items). The total number of items at this stage was 77.

Fourth step: pilot evaluation

A pilot evaluation of the face validity, content validity and comprehensibility of the items, and clarity of instructions, was conducted by the researcher (TS). This involved interviews with eight patients in late palliative phases after completion of the questionnaire. Patients in the pilot study were recruited from two hospice inpatient units (n = 4) and two hospice day-care units (n = 4). Four men and four women, with ages ranging from 45 to 70 years, participated. The interview consisted of the following topics: relevance of items to quality of palliative care, perceptions about completing the questionnaire, length of the questionnaire, comprehensibility of the items and instructions for filling out the questionnaire, and suggestions for improving items.

The results from the pilot evaluation showed that items comprised quality of palliative care, and that items and instructions were comprehensible, but the number of items was perceived as too high. Based on these results, critical assessment of the items was performed by the research group, resulting in a reduction in the wording of 31 items. In addition, a conflation of items was performed which resulted in the removal of eight items considered to be covered by other items. For example, the two items measuring a secure atmosphere and a pleasant atmosphere were reduced to: ‘There is a pleasant and secure atmosphere at the ward’. This step resulted in a total of 69 items.

Patient characteristics

Age ranged from 41 to 94 years, and 50 % of the participants were aged >67 years (n = 184). Of the participants 56 % were women and 52 % lived alone. Most had Norwegian as their first language (93 %), with 76 % having a cancer diagnosis and 70 % just one diagnosis. With regard to education, 24.6 % had education up to primary school, 38.5 % to high school and 36.9 % to university education (Table 1).

Table 1 Patient characteristics (n = 184)

Construct validity measured by EFA using PCA

To ensure a stable factor solution, further reductions of items were needed before doing the PCA. A critical assessment of items was carried out, guided by the results of the descriptive analysis of the response alternative ‘not applicable’ (and missed observations). Of the 69 items, 17 were excluded because a high proportion (>35 %) of patients scored them as ‘not applicable’/missed observations and these items were assessed to also be covered by existing items.

The item about the atmosphere on the ward was ‘not applicable’ to those receiving home care, but was perceived to be important for patients in hospices (day and inpatient care) and nursing homes, so therefore it was kept in the instrument as a single item. This left 51 items for further psychometric evaluation, and one additional single item.

As Bartlett’s test of sphericity was significant (P <0.05), this indicated that the data were considered suitable for FA [37]. The KMO value was 0.82, indicating that the sample should produce reliable and distinct factors [36]. The initial PCA analysis showed that the structure of the answers of the two items ‘I receive the best possible help to take care of my personal hygiene’ and ‘I receive the best possible medical care’ produced different patterns from the other items in the factor. However, as the SI scores were high, these two items were kept as single items because of their importance to the patients.

For the remaining 49 items PCA revealed 12 factors with an eigenvalue >1.0, which explained 68.25 % of the total variance. Extracted factors with eigenvalues >1.00 for the SI-scale at item- and factor levels are shown in Table 2.

Table 2 Rotation matrix for the 12-factor structure of the 49-item QPP-PC, SI scale (n = 184)

The factor solution was supported by the varimax rotation matrix, and revealed a number of strong loaded items (>0.4) in each factor. Three items loaded just below 0.4 (‘Help for pain’, ‘Help for shortness of breath’ and ‘Information about medication’). These items were kept because they showed sufficient correlation [37] and because patients scored them as of high to highest importance (SI score: mean 3.07–3.58; standard deviation [SD] 0.68–1.03). All items were kept in the factor in which they loaded the highest, except for the following items: ‘Help for shortness of breath’, ‘Information about medication’ and ‘Cooperative services’, which were placed according to knowledge in the field.

PCA was also carried out for the PR scale. The results from the PCA for the items within the PR scale showed similar patterns, as demonstrated for the SI scale in Table 2.

This was also the case for the results of PCA analysis at the dimensional level for the QPP dimensions: medical–technical competence (MT), identity-oriented approach (ID), physical–technical conditions (PT) and sociocultural atmosphere (SC) for both SI and PR.

Reliability

Internal consistency estimated with Cronbach’s α is shown in Table 3. At the factor level range, α is between 0.79 and 0.96, except for the factors ‘Access to help, food and equipment’ (α = 0.65) and ‘Continuity’ (α = 0.55). At the dimensional level values ranged between 0.91 and 0.94 for the SI scale, apart from the PT dimension (α = 0.65).

Table 3 The QPP-PC, inclusive dimensions, factors, 49 items and 3 single items

Patients’ perceptions of quality of palliative care

The highest levels of SI as well as PR were reported for the factors ‘Respect and empathy’ and ‘Honesty’ in the ID dimension. The highest levels for SI and PR were reported for the single item about the atmosphere in the SC dimension. In addition, high levels of SI were reported for the single item medical care in the MT dimension

The lowest levels for SI as well as PR were reported for the factor ‘Exhaustion’ in the MT dimension and ‘Spiritual and existential’ in the SC dimension.

When comparing patients’ scores for the SI and PR scales, SI scales were statistically significantly higher for the factor ‘Symptom relief’ in the MT dimension, for the factors “‘Information’ and ‘Participation’ in the ID dimension and for the factors “‘Continuity’ and ‘Planning and cooperation’ in the SC dimension. In addition, for the single items, the SI scale was statistically significantly higher than the PR scale for the item about medical care (MT dimension) and for the item about atmosphere (SC dimension), the SI scale was significantly lower than the PR scale (Table 4).

Table 4 Comparison of patients’ perceptions of subjective importance and care received, by dimensions, factors and single items

Discussion

Methodological considerations

One way of assessing whether the QPP-PC is a reliable and valid instrument is to measure the QPP-PC according to the criteria stated by van Campen et al. [23]: instruments should (1) be based on a theoretical foundation, (2) contain a subscale representing different aspects of quality of care, (3) be tested for reliability and validity, and (4) be feasible in large populations. In our opinion, the QPP-PC meets these criteria.

The items in the QPP-PC still reflect all four dimensions of the theoretical model of quality of care derived from patients’ perspectives, on which the QPP is based. Sitzia[40] elaborated on the validity assessment of instruments by stating that studies should provide results for content validity comprising strategies for item generation and content testing. Items in the QPP-PC were developed based on the perspective of patients receiving palliative care, ensuring that the items developed are perceived as relevant for these patients. The pilot test showed good face and content validity; this was supported by high patients’ scores on the SI scale for each dimension, factor and single item (Table 4), which was also the case at the level of the items (not reported). Consequently, this supported the content validity of the instrument [40].

The construct validity [40] was evaluated by performing an explorative factor analysis using PCA, which showed a stable 12-factor solution for the SI and PR scales, with most items correlating strongly with the factors. Compared with the original QPP, three new factors appeared: ‘Exhaustion’, ‘Continuity’ and ‘Planning and cooperation’. Although ‘Exhaustion’ appeared as a new factor, this aspect of care has been present as items in the MT dimension of the previous QPP instrument (personal communications with the author Wilde-Larsson). Previous research supports continuity, and planning and cooperation are important for patients who receive palliative care [32, 41, 42] and should be included in measures in palliative care [12]. Compared to existing instruments measuring palliative care quality from patients’ perspectives [1822], QPP-PC consists of similar aspects of care. However, to our knowledge, previous instruments do not cover all these aspects of care in one single instrument.

Two items correlated with factors that differed from the original version of the QPP. The item about waiting times was previously described as a factor belonging to the MT dimension; however, in this study this item correlated with items in the factor ‘Access to help, food and equipment’, placed in the PT dimension. The item about individualized care was previously described as a factor belonging to ‘Routines’. In this study, this item correlated with items in the factor ‘Continuity’. By developing new items and testing these in a new context, new constructs of items may appear that could partly explain the differences experienced in this study. With regard to continuity, it is reasonable to think that receiving help from the same doctors and nurses influences individualized care, and these items may therefore be expected to correlate. These findings need to be supported by further studies; we suggest that further validation of the instrument be obtained by confirmatory factor analysis.

Reliability [40] was assessed by Cronbach’s α, and values were >0.7 for most factors and dimensions on both the PR and the SI scales, indicating good internal consistency [37]. This is in line with previous studies using the QPP in other contexts [29]. However, the factor ‘Access to help, food and equipment’, in the PT dimension, and the factor ‘Continuity’ showed α values <0.7. This α value for the PT dimension is in line with previous studies using the QPP in the context of hospital care [27, 39]. The α values are sensitive to the number of items, and low numbers may lead to low α values, which could possibly explain the results [36]. The factors ‘Spiritual and existential’ and ‘Meaningfulness’ gained high α levels, which may be explained by the items within both of these factors being the same questions asked by different healthcare personnel.

The limitation in this study could be related to sample size. Based on previous studies using the QPP in related samples [30, 31, 43], an expected medium effect size was estimated, resulting in inclusion of a minimum of 300 participants to achieve a minimum 80 % power. However, it is difficult to recruit large samples from this specific patient population, because they are in the palliative phase of their illness. Even though the data collection period was extended by six months, the estimated sample size was not achieved. This was due to a combination of factors, e.g., several patients with cognitive impairment and some patients who died before the implementation of already scheduled interviews.

The recommended sample size needed to perform a stable and reliable factor solution varies from a minimum of 50 cases to a ratio of participants to variables of 20:1, with a desired ratio of 5:1 [37]. Others argue that the minimum sample size is not valid and useful and that stable factor solutions can be achieved with a sample size that is considered too small for the above-mentioned ‘rules of thumb’ [44]. To improve items and to reduce the number of items, the research group performed critical assessments of all items on two occasions (after the pilot and before the PCA); this could enhance a stable factor solution. In this study, the KMO test was >0.8 for the whole instrument and >0.6 for all individual factors. In addition, a stable pattern of factors was present at the SI and PR scale levels and dimensional levels. Consequently, the sample size appeared to be sufficient to achieve a reliable and stable factor solution.

The advantages of an instrument developed for patients with different illnesses who get help from different services are many, i.e. when comparing groups of patients and services. However, the disadvantage is naturally higher proportions of the response alternative ‘not applicable’. For example, items about relief of shortness of breath may be regarded as highly relevant for some patients, on the other hand, irrelevant by patients with no difficulty breathing. Factors and dimensions in the QPP are computed by calculating a mean of all the items in the respective factors and dimensions. When patients respond ‘not applicable’ for one item in one factor or dimension, it is not possible to automatically calculate a factor or dimension score for this patient. For the T-tests, a mean therefor was calculated based on patients’ individual responses to the remaining items in the respective factor or dimension. For the PCA, a mean of the remaining responses in the respective variable substituted the “not applicable” response [38]. This allowed patients to be included in the analysis even when some items were recorded as ‘not applicable’. One may say that this recognizes ‘not applicable’ as a valid response alternative. However, this could imply a risk for correlations with the substituted mean rather than with the remaining patients’ responses to the respective items in the PCA [45] . To reduce this risk, seven patients with particularly high proportions of “not applicable” or missing responses were excluded from the analysis. However, the factors that appeared as a result of the PCA analysis needs to be interpreted with caution and to be supported by further studies.

QPP-PC identifies issues known in the literature as being important aspects of palliative care, in addition patients scored the subjective importance to be high for most of the factors, dimensions and single items. This indicates that QPP-PC could be considered to be generalizable and relevant. However, patients receiving palliative care in Norway are cared for in settings that have not been included in this study, e.g. hospital wards and nursing homes not specialized in palliative care. Even if the QPP-PC items were derived from hospital settings, as well as hospices, nursing homes and home care [24, 25, 32], and had been supported by a recent review to identify the most important aspects of palliative care in hospitals [46], the QPP-PC would need to be tested in other contexts, cultures and countries to support these findings.

A final limitation is that no specific measurement was made of the time needed by patients to complete the instrument.

Discussion of result about patients’ perceptions of quality of palliative care

Most factors and dimensions on the SI scale were scored as of high or highest importance. High scores were also obtained for most factors and dimensions of the actual care received (PR scale). Previous studies using the QPP in palliative care showed similar results [30, 31]. However, the results revealed that patients scored on SI scales higher than on PR scales with regard to ‘Symptom relief’, ‘Information’, ‘Participation’, ‘Continuity’ and ‘Planning and cooperation’, indicating that patients experienced these aspects of care as not as high as they may have wished for (areas for improvement). Previous studies confirm that improvement in these aspects of care is needed [41, 42, 4751]. Further research is needed to investigate whether subgroups of patients differ with regard to their perceptions of care quality and whether there are differences in perceptions of care quality between patients in different palliative settings.

Conclusion

The QPP-PC is based on a theoretical model of quality of care, and has its roots in patients’ perspectives; this gives patients undergoing palliative care a voice when measuring and evaluating the quality of care. The instrument was contextually adapted and psychometrically evaluated in a sample of Norwegian patients receiving palliative care. Although further validation of the QPP-PC is needed to support these findings, the results are promising. Patients evaluated most factors and dimensions on the SI scale as of high or highest importance. High scores were also obtained for most factors and dimensions of the actual care received. Areas for improvement have been presented with regard to symptom relief, participation, continuity, and planning and cooperation.

Clinical implications

The advantage of the QPP-PC is that the instrument includes measures of both subjective importance and perceived reality of care. This is particularly valuable for guiding the improvement of palliative care at all levels. Future improvement initiatives should focus on aspects of care receiving high scores on the SI scale and low scores on the PR scale (actual care received).

Abbreviations

QPP:

The instrument Quality from the Patient’s Perspective

QPP-PC:

QPP instrument specific to palliative care

MT:

Medical–technical competence dimension

ID:

Identity-oriented approach dimension

PT:

Physical–technical conditions dimension

SC:

Sociocultural atmosphere dimension

SI:

Subjective importance scale

PR:

Perceived reality scale

EFA:

Exploratory factor analysis

PCA:

Principal component analysis

KMO:

Kaiser–Meyer–Olkin test

References

  1. 1.

    World Health Organization (WHO). National Cancer Control Programmes: Policies & Managerial Guidelines. 2nd ed. Geneva: WHO; 2002.

    Google Scholar 

  2. 2.

    European Association for Palliative Care (EAPC). White Paper on standards and norms for hospice and palliative care in Europe: part 1. Recommendations from the European Association for Palliative Care. Eur J Palliat Care. 2009;16(6):278–89.

    Google Scholar 

  3. 3.

    Kaasa S, Jordhøy MS, Haugen DF. Palliative Care in Norway: A National Public Health Model. J Pain Symptom Manage. 2007;33(5):599–604.

    Article  PubMed  Google Scholar 

  4. 4.

    Ministry of Health and Care Services. Rapport om tilbudet til personer med behov for lindrende behandling og omsorg mot livets slutt - å skape liv til dagene. Rapport nr. IS-2278. [Report on services to persons in need of palliative treatment and care towards the end of life - to bring life to the days. Report from The Norwegian Directorate of Health. Report no. IS-2278]. Oslo: Helse- og omsorgsdepartementet; 2015.

  5. 5.

    Grande G. Palliative care in hospice and hospital: time to put the spotlight on neglected areas of research. Palliat Med. 2009;23(3):187–9.

    CAS  Article  PubMed  Google Scholar 

  6. 6.

    World Health Organisation (WHO). The Solid Facts. Palliative Care. Geneva: WHO; 2004.

    Google Scholar 

  7. 7.

    Donabedian A. Explorations in quality assessment and monitoring. The definition of quality and approaches to its assessment, vol. 1. Ann Arbor: Health Administration Press; 1980.

    Google Scholar 

  8. 8.

    World Health Organization (WHO). Quality of care: a process for making strategic choices in health systems. Geneva: WHO; 2006.

    Google Scholar 

  9. 9.

    Singer PA, Martin DK, Kelner M. Quality end-of-life care. Patients’ perspectives. J Am Med Assoc. 1999;281(2):163–8.

    CAS  Article  Google Scholar 

  10. 10.

    Ministry of Health and Care Services. Morgendagens omsorg. Melding til Stortinget nr. 29. [Future Care. Report to the Storting (Norwegian Parliament) no. 29.]. Oslo: Helse- og omsorgsdepartementet; 2012–2013.

  11. 11.

    Ministry of Health and Care Services. God kvalitet – trygge tjenester — Kvalitet og pasientsikkerhet i helse- og omsorgstjenesten. Melding til stortinget nr. 10. [High Quality - Safe Services — Quality and Patient safety in the Health and Care Services. Report to the Storting (Norwegian Parliament) no.10]. Oslo: Helse- og omsorgsdepartementet; 2012–2013.

  12. 12.

    Mularski RA, Dy SM, Shugarman LR, Wilkinson AM, Lynn J, Shekelle PG, et al. A Systematic Review of Measures of End of Life Care and Its Outcomes. Health Serv Res. 2007;42(5):1848–70.

    PubMed Central  Article  PubMed  Google Scholar 

  13. 13.

    Unroe KT, Meier DE. Research priorities in geriatric palliative care: policy initiatives. J Palliat Med. 2013;16(12):1503–8.

    PubMed Central  Article  PubMed  Google Scholar 

  14. 14.

    Kristjanson LJ. Validity and reliability testing of the FAMCARE scale: Measuring family satisfaction with advanced cancer care. Soc Sci Med. 1993;36(5):693–701.

    CAS  Article  PubMed  Google Scholar 

  15. 15.

    Addington-Hall J, Walker L, Jones C, Karlsen S, McCarthy M. A randomised controlled trial of postal versus interviewer administration of a questionnaire measuring satisfaction with, and use of, services received in the year before death. J Epidemiol Community Health. 1998;52(12):802–7.

    PubMed Central  CAS  Article  PubMed  Google Scholar 

  16. 16.

    Morita T, Hirai K, Sakaguchi Y, Maeyama E, Tsuneto S, Shima Y. Measuring the quality of structure and process in end-of-life care from the bereaved family perspective. J Pain Symptom Manage. 2004;27(6):492–501.

    Article  PubMed  Google Scholar 

  17. 17.

    Lo C, Burman D, Rodin G, Zimmermann C. Measuring patient satisfaction in oncology palliative care: psychometric properties of the FAMCARE-patient scale. Qual Life Res. 2009;18(6):747–52.

    Article  PubMed  Google Scholar 

  18. 18.

    Miyashita M, Wada M, Morita T, Ishida M, Onishi H, Tsuneto S, et al. Care Evaluation Scale—Patient Version: Measuring the Quality of the Structure and Process of Palliative Care From the Patient’s Perspective. J Pain Symptom Manage. 2014;48(1):110–8.

    Article  PubMed  Google Scholar 

  19. 19.

    Lo C, Burman D, Hales S, Swami N, Rodin G, Zimmermann C. The FAMCARE-Patient scale: Measuring satisfaction with care of outpatients with advanced cancer. Eur J Cancer. 2009;45(18):3182–8.

    Article  PubMed  Google Scholar 

  20. 20.

    Heyland DK, Cook DJ, Rocker GM, Dodek PM, Kutsogiannis DJ, Skrobik Y, et al. The development and validation of a novel questionnaire to measure patient and family satisfaction with end-of-life care: The Canadian Health Care Evaluation Project (CANHELP) Questionnaire. Palliat Med. 2010;24(7):682–95.

    Article  PubMed  Google Scholar 

  21. 21.

    Engelberg RA, Downey L, Wenrich MD, Carline JD, Silvestri GA, Dotolo D, et al. Measuring the Quality of End-of-Life Care. J Pain Symptom Manage. 2010;39(6):951–71.

    Article  PubMed  Google Scholar 

  22. 22.

    Sulmasy DP, McIlvane JM, Pasley PM, Rahn M. A scale for measuring patient perceptions of the Quality of End-of-life care and Satisfaction with Treatment: The reliability and validity of QUEST. J Pain Symptom Manage. 2002;23(6):458–70.

    Article  PubMed  Google Scholar 

  23. 23.

    van Campen C, Sixma H, Friele RD, Kerssens JJ, Peters L. Quality of care and patient satisfaction: a review of measuring instruments. Med Care Res Rev. 1995;52(1):109–33.

    Article  PubMed  Google Scholar 

  24. 24.

    Wilde B, Starrin B, Larsson G, Larsson M. Quality of care from a patient perspective. A grounded theory study. Scand J Caring Sci. 1993;7:113–20.

    CAS  Article  PubMed  Google Scholar 

  25. 25.

    Wilde BLG, Larsson M, Starrin B. Quality of care. Developement of a patient-centered questionnaire based on a grounded theory model. Scand J Caring Sci. 1994;8:39–48.

    CAS  Article  PubMed  Google Scholar 

  26. 26.

    Larsson G, Wilde Larsson B, Munck IM. Refinement of the questionnaire ‘quality of care from the patient’s perspective’using structural equation modelling. Scand J Caring Sci. 1998;12(2):111–8.

    CAS  PubMed  Google Scholar 

  27. 27.

    Wilde Larsson B, Larsson G. Development of a short form of the Quality from the Patient’s Perspective (QPP) questionnaire. J Clin Nurs. 2002;11(5):681–7.

    Article  PubMed  Google Scholar 

  28. 28.

    Wilde‐Larsson B, Larsson G, Kvist LJ, Sandin‐Bojö AK. Womens’ opinions on intrapartal care: development of a theory‐based questionnaire. J Clin Nurs. 2010;19(11–12):1748–60.

    PubMed  Google Scholar 

  29. 29.

    Holter H, Sandin-Bojö A-K, Gejervall A-L, Wikland M, Wilde-Larsson B, Bergh C. Quality of care in an IVF programme from a patient’s perspective: development of a validated instrument. Hum Reprod. 2014;29(3):534–47.

    Article  PubMed  Google Scholar 

  30. 30.

    Wilde Larsson B, Larsson G, Carlson SR. Advanced home care: patients’ opinions on quality compared with those of family members. J Clin Nurs. 2004;13(2):226–33.

    Article  Google Scholar 

  31. 31.

    Henoch I, Lövgren M, Wilde-Larsson B, Tishelman C. Perception of quality of care: comparison of the views of patients’ with lung cancer and their family members. J Clin Nurs. 2011;21:585–94.

    Article  PubMed  Google Scholar 

  32. 32.

    Sandsdalen T, Hov R, Høye S, Rystedt I, Wilde-Larsson B. Patients’ preferences in palliative care: A systematic mixed studies review. Palliat Med. 2015;29(5):399–419.

    Article  PubMed  Google Scholar 

  33. 33.

    Thomas K et al. Prognostic Indicator Guidance (PIG), The Gold Standards Framework Centre In End of Life Care CIC. 4th ed. 2011. http://www.goldstandardsframework.org.uk/cd-content/uploads/files/General%20Files/Prognostic%20Indicator%20Guidance%20October%202011.pdf. Accessed 30 Jun 2015.

    Google Scholar 

  34. 34.

    Bruera E, Kuehn N, Miller MJ, Selmser P, Macmillan K. The Edmonton Symptom Assessment System (ESAS): a simple method for the assessment of palliative care patients. J Palliat Care. 1991;7(2):6–9.

    CAS  PubMed  Google Scholar 

  35. 35.

    Watanabe SM, Nekolaichuk C, Beaumont C, Johnson L, Myers J, Strasser F. A Multicenter Study Comparing Two Numerical Versions of the Edmonton Symptom Assessment System in Palliative Care Patients. J Pain Symptom Manage. 2011;41(2):456–68.

    Article  PubMed  Google Scholar 

  36. 36.

    Field A. Discovering statistics using SPSS. 4th ed. Los Angeles: Sage; 2013.

    Google Scholar 

  37. 37.

    Hair JF, Black WC, Babin BJ, Anderson RE. Exploratory Factor Analysis. In: Hair JF, Black WC, Babin BJ, Anderson RE, editors. Multivariate data analysis, 7th Pearson new international ed. Harlow: Pearson; 2014.

    Google Scholar 

  38. 38.

    Fox‐Wasylyshyn SM, El‐Masri MM. Handling missing data in self report measures. Res Nurs Health. 2005;28(6):488–95.

    Article  PubMed  Google Scholar 

  39. 39.

    Grøndahl VA, Karlsson I, Hall-Lord ML, Appelgren J, Wilde-Larsson B. Quality of care from patients’ perspective: impact of the combination of person-related and external objective care conditions. J Clin Nurs. 2011;20(17/18):2540–51.

    Article  PubMed  Google Scholar 

  40. 40.

    Sitzia J. How valid and reliable are patient satisfaction data? An analysis of 195 studies. Int J Qual Health Care. 1999;11(4):319–28.

    CAS  Article  PubMed  Google Scholar 

  41. 41.

    Heyland DK, Cook DJ, Rocker GM, Dodek PM, Kutsogiannis DJ, Skrobik Y, et al. Defining priorities for improving end-of-life care in Canada. CMAJ. 2010;182(16):E747–52.

    PubMed Central  Article  PubMed  Google Scholar 

  42. 42.

    Murray SA, Boyd K, Kendall M, Worth A, Benton TF, Clausen H. Dying of lung cancer or cardiac failure: Prospective qualitative interview study of patients and their carers in the community. Br Med J. 2002;325(7370):929–32.

    Article  Google Scholar 

  43. 43.

    Lövgren M, Wilde-Larsson B, Hök J, Leveälahti H, Tishelman C. Push or pull? Relationships between lung cancer patients’ perceptions of quality of care and use of complementary and alternative medicine. Eur J Oncol Nurs. 2011;15(4):311–7.

    Article  PubMed  Google Scholar 

  44. 44.

    MacCallum RC, Widaman KF, Preacher KJ, Hong S. Sample Size in Factor Analysis: The Role of Model Error. Multivar Behav Res. 2001;36(4):611–37.

    Article  Google Scholar 

  45. 45.

    Tabachnick BG, Fidell LS. Principal components and factor analysis. In: Tabachnick BG, Fidell LS, editors. Using multivariate statistics, 6th New International ed. Essex: Pearson; 2014. p. 659–730.

    Google Scholar 

  46. 46.

    Virdun C, Luckett T, Davidson PM, Phillips J. Dying in the hospital setting: A systematic review of quantitative studies identifying the elements of end-of-life care that patients and their families rank as being most important. Palliat Med. 2015; doi: 10.1177/0269216315583032.

  47. 47.

    Werkander Harstäde C, Andershed B. Good palliative care: How and where? The patients’ opinions. J Hosp Palliat Nurs. 2004;6(1):27–35.

    Article  Google Scholar 

  48. 48.

    Torvik K, Kaasa S, Kirkevold Ø, Rustøen T. Pain in patients living in Norwegian nursing homes. Palliat Med. 2009;23:8–16.

    CAS  Article  PubMed  Google Scholar 

  49. 49.

    Strohbuecker B, Eisenmann Y, Galushko M, Montag T, Voltz R. Palliative care needs of chronically ill nursing home residents in Germany: focusing on living, not dying. Int J Palliat Nurs. 2011;17(1):27–34.

    Article  PubMed  Google Scholar 

  50. 50.

    Escobar Pinzon LC, Munster E, Fischbeck S, Unrath M, Claus M, Martini T, et al. End-of-life care in Germany: Study design, methods and first results of the EPACS study (Establishment of Hospice and Palliative Care Services in Germany). BMC Palliat Care. 2010;9(1):16.

    PubMed Central  Article  PubMed  Google Scholar 

  51. 51.

    Burge F, Lawson B, Johnston G, Asada Y, McIntyre P, Grunfeld E, et al. Bereaved family member perceptions of patient-focused family-centred care during the last 30 days of life using a mortality follow-back survey: does location matter? BMC Palliat Care. 2014;13(1):25.

    PubMed Central  Article  PubMed  Google Scholar 

Download references

Acknowledgements

The authors wish to thank all the patients who were willing to spend their valuable time participating in this study. We also want to thank each of the nurses responsible for screening and recruiting patients, and the leaders and head administrators from the participating wards. Last, we want to thank Jari Appelgren for valuable statistical advice and assistance when performing the statistical analysis and writing the article.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Tuva Sandsdalen.

Additional information

Competing interests

This study is part of a doctoral study, financed partly by Hedmark University College and partly by Lovisenberg Diakonale Hospital. The authors declare that they have no competing interests.

Authors’ contributions

All the authors (TS, IR, VAG, RH, SH, BWL) were involved in developing the design and method, and adaptation of the instrument. TS performed the acquisition of data. TS and BWL performed the analysis of data. All authors (TS, IR, VAG, RH, SH, BWL) were involved in the interpretation of analysis. TS wrote the draft manuscript. All authors (TS, IR, VAG, RH, SH, BWL) were involved in reading and revising the manuscript critically and approved the final manuscript.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Sandsdalen, T., Rystedt, I., Grøndahl, V.A. et al. Patients’ perceptions of palliative care: adaptation of the Quality from the Patient’s Perspective instrument for use in palliative care, and description of patients’ perceptions of care received. BMC Palliat Care 14, 54 (2015). https://doi.org/10.1186/s12904-015-0049-4

Download citation

Keywords

  • Palliative care
  • Quality of healthcare
  • Instrument development
  • Factor analysis
  • Statistical
  • Patient perspectives
\