Skip to main content

Advertisement

We’d like to understand how you use our websites in order to improve them. Register your interest.

Palliative Performance Scale: cross cultural adaptation and psychometric validation for Polish hospice setting

Abstract

Background

Measuring functional status in palliative care may help clinicians to assess a patient’s prognosis, recommend adequate therapy, avoid futile or aggressive medical care, consider hospice referral, and evaluate provided rehabilitation outcomes. An optimized, widely used, and validated tool is preferable. The Palliative Performance Scale Version 2 (PPSv2) is currently one of the most commonly used performance scales in palliative settings. The aim of this study is the psychometric validation process of a Polish translation of this tool (PPSv2-Polish).

Methods

Two hundred patients admitted to a free-standing hospice were evaluated twice, on the first and third day, for test-retest reliability. In the first evaluation, two different care providers independently evaluated the same patient to establish inter-rater reliability values. PPSv2-Polish was evaluated simultaneously with the Karnofsky Performance Score (KPS), Eastern Cooperative Oncology Group (ECOG) Performance Status (ECOG PS), and Barthel Activities of Daily Living (ADL) Index, to determine its construct validity.

Results

A high level of full agreement between test and retest was seen (63%), and a good intra-class correlation coefficient of 0.85 (P < 0.0001) was achieved. Excellent agreement between raters was observed when using PPSv2-Polish (Cohen’s kappa 0.91; P < 0.0001). Satisfactory correlations with the KPS and good correlations with ECOG PS and Barthel ADL were noticed. Persons who had shorter prognoses and were predominantly bedridden also had lower scores measured by the PPSv2-Polish, KPS and Barthel ADL. A strong correlation of 0.77 between PPSv2-Polish scores and survival time was noted (P < 0.0001). Moderate survival correlations were seen between KPS, ECOG PS, and Barthel ADL of 0.41; − 0.62; and 0.58, respectively (P < 0.0001).

Conclusion

PPSv2-Polish is a valid and reliable tool measuring performance status in a hospice population and can be used in daily clinical practice in palliative care and research.

Peer Review reports

Background

Functional decline, in addition to symptom burden, results in increased dependency on others and negatively affects a patient’s quality of life. Most people want to remain symptom-free and to maintain as much independence as possible until the latest phases of life. The importance of measuring functional status in palliative care is incontestable. It may help clinicians to assess a patient’s prognosis, recommend further oncological therapy, avoid futile, aggressive medical care, consider hospice referral and evaluate provided rehabilitation outcomes. All measuring tools may have disadvantages, and an optimal one, which may also be used in monitoring the outcomes of physical therapy, specifically in palliative care, is lacking [1]. The Palliative Performance Scale version 2 (PPSv2) is currently one of the most commonly used performance scales in palliative settings. It was developed by the Victoria Hospice Society as a modification of the Karnofsky Performance Scale in 1996 [2] and validated later [3]. It has also been demonstrated that PPSv2 correlates with patients’ survival time [4]. Although occasionally used in Poland, it has not been validated yet. It is reasonable to disseminate knowledge among professionals and promote its use through cultural adaptation.

Methods

Aim

The aim of this study is the cross cultural adaptation and psychometric validation of a Polish translation of PPSv2 tool (PPSv2-Polish).

Design

We obtained agreement and guidelines for the translation process from the Victoria Hospice Society, the owner of the tool.

The tool translation and back-translation were done in cooperation of three palliative care centers: St. Lazarus Hospice in Krakow, Medical University of Warsaw (Poland), and Jagiellonian University Medical College, Krakow, Poland.

The testing and retesting of PPSv2-Polish was performed by the hospice care team at St. Lazarus Hospice in Krakow (Poland).

Patient characteristics, including gender, age, primary diagnosis, and disease stage based on the Gold Standard Framework needs based coding (GSF; see Table 1) [5] assessed by the attending physician, were obtained from medical records. All participants were evaluated twice, on the first and third day, for test-retest reliability by the same member of the hospice care team at St. Lazarus Hospice in Krakow (Poland) (a trained and experienced palliative care nurse, psychologist, or physiotherapist), who cared for the patient. Additionally, on the first evaluation, two different care providers (each time by different types of professionals) independently evaluated the same patient to establish inter-rater reliability values. Each patient’s evaluation encompassed the PPSv2-Polish, which was compared simultaneously with 3 additional performance scales, considered the gold standard [6], to accomplish its external construct validity.

Table 1 GSF Needs Based Coding

Participants

Among 223 patients consecutively admitted to an in-patient hospice (between September 1st and November 30th 2019), 200 (aged ≥18 years), who were Polish native speakers whose performance status was unlikely to change significantly during the nearest 3 days according to the attending physician, were recruited and enrolled in the study.

Measures

Palliative performance scale version 2 (PPSv2)

The PPS provides a functional assessment of a patient’s ambulation, activity level, evidence of disease, self-care, food/fluids intake, and level of consciousness. The PPS has 11 categories, from 100% (full mobile and healthy) to 0% (dead) in decrements of 10%. In 2006, PPS version 2 (PPSv2) was introduced after clarification of instructions for its use [7].

PPSv2-polish translation process

A modified combined translation technique [8] of PPSv2 into Polish was applied, which consisted of 1) independent forward translations by a physician, a psychologist and a Polish native speaker, 2) team discussion on identified differences between these 3 versions until agreement, 3) independent backward translations by a physician, a psychologist and a native English speaker, and 4) second team discussion on any differences between the original and back-translated versions until all agreed that the two versions were semantically identical (Fig. 1).

Fig. 1
figure1

Graphical representation of translation process of PPSv2-Polish

This method followed the Victoria Hospice translation guidelines sent to the authors. The discussed back-translated version was then preliminarily tested in the hospice on 20 patients to obtain the final version of the PPSv2 (PPSv2-Polish – see Additional file 1). The implementation process encompassed education of the medical staff participating in this study during one training session, based on the Victoria Hospice Society instructions sent to the authors, giving the opportunity to get feedback from the team members.

Karnofsky performance score (KPS)

The KPS ranking is an 11-point scale and runs from 100% - perfect health, to 0% - dead. While first published in 1948 [9] to evaluate the ability to survive chemotherapy for cancer, it has recently undergone several evaluation adjustments [10]. The KPS provides great consistency of ratings by different oncology professionals [11]. It may also serve as a life survival predictor [12]. Hovewer, it has not been validated in Poland yet.

Eastern cooperative oncology group (ECOG) performance status (ECOG PS)

This scale, also called the World Health Organization (WHO) score, was published in its current form by ECOG in 1982 [13] to assess a patient’s level of functioning in terms of the ability to care for himself, daily activity, and physical ability, in order to measure the impact of the disease/treatment on performance status. It has a good intra and interobserver agreement in cancer patients’ performance status assessment [14]. It consists of 6 categories, from 0 - fully active, to 5 - dead, and is simpler to use, may be clinically preferable in comparison to the KPS, [15] and is widely used in the literature, yet not validated in Poland.

Barthel activities of daily living (ADL) index

This “simple index of independence” was published in 1965 for measuring the improvement during rehabilitation of the chronically ill" [16]. The original version was modified in 1988 to a 20 point scale that measures in increments of 1 point: from 0 - fully dependent, to 20 - fully independent [17]. The final score can be multiplied by 5 to obtain a 100 point score, and it is proposed that scores of 0–20 indicate “total” dependency, 21-60 indicate “severe” dependency, 61–90 indicate “moderate” dependency, and 91–99 indicates “slight” dependency. It is already widely used as the measurement of daily living activities and has become a standard measure of physical disability in practice [18]. Ten categories are assessed: feeding, grooming, bathing, dressing, toilet use, presence of fecal incontinence, presence of urinary incontinence, transfers (e.g., moving from wheelchair to bed), walking on an even surface (or propelling a wheelchair if unable to walk), and ascending and descending stairs. This scale has been widely used, however, has not yet been adapted in Poland.

Statistical analysis

We summarized the baseline demographics using descriptive statistics and medians with interquartile ranges (IQR) in non-normally (according to Shapiro-Wilk test) distributed ordinal quantitative data. A Wilcoxon signed-rank test was used to compare test-retest of ordinal data in one sample in test-retest and inter-rater comparison. Non-parametric data within subgroups of patients were compared using a Mann-Whitney U test. The strength of the relationship between the test-retest variables, and between the tools scores and survival time were calculated with the Spearman’s rank correlation coefficient. The inter-rater reliability was estimated using Cohen’s kappa statistics. Data were analyzed using STATISTICA 13.0 (TIBCO Software Inc. 2017) data analysis software. A P-value of < 0.05 was considered as the level for statistical significance. The sample size for this survey was based on general guidelines for conducting qualitative research [19] As there are no absolute rules for the sample size needed to validate a questionnaire a fair size of 200 patients was chosen.

Results

In all cases the hospice staff were able to complete the evaluation according to the study protocol (no missing values, a response rate of 100%), and they assessed the tool as easy to use and not excessively time consuming. This indicates that the PPSv2-Polish appeared a feasible and acceptable assessment tool in their practice. At the beginning of implementation, in the training phase of this study, two out of six team members made observations that the 5-steps of PPSv2-Polish assessment was a bit prolonged, in comparison with 1-step assessment of KPS or ECOG PS. All participating staff emphasized the need for observation of a patient for a reasonable period of time to accurately asses his or her true “capable” functions based on the “observed” ones, during the day shift.

The majority of patients were aged, had advanced cancer, with short (weeks) prognosis according to GSF, and finally died at the hospice (Table 2).

Table 2 Patient characteristics and description

Test-retest reliability

The median PPSv2-Polish value within the first measurement was 30 (IQR 10), which correlated with the data obtained 2 days later (median 30; IQR 20) by the same care provider. We achieved a high level of full agreement between test and retest (63%) and a good intra-class correlation coefficient of 0.85 (P < 0.0001).

Inter-rater reliability

An excellent PPSv2-Polish agreement between raters was observed (Cohen’s kappa 0.91; P < 0.0001). A high level (94–99%) of full agreement between raters was observed, with the exception of ECOG PS, where this agreement was not achieved (Table 3).

Table 3 Inter-rater agreement of scales used in the study

Criterion validity

Satisfactory correlations with the KPS and good correlation with ECOG PS and Barthel ADL were noticed (Table 4).

Table 4 Correlations between the scales used in the study

Known-group validity

Persons who had shorter prognosis and were predominantly bedridden also had lower scores measured by the PPSv2-Polish, KPS and Barthel ADL (Table 5).

Table 5 Responsiveness of the scales

Survival estimation

A strong correlation between each category assessed in PPSv2-Polish and survival time was noted (0.77; P < 0.0001). Median survival time (IQR) in GSF B, C and D group was respectively 37 (21.3), 23 (13.0) and 12 (23.5) days. Moderate survival correlations were observed between KPS, ECOG PS, and Barthel ADL Index scores (0.41, − 0.62, and 0.58, respectively; P < 0.0001).

Discussion

The PPSv2-Polish which was created with a combined translation technique appears to be a valuable clinical assessment tool in the hospice setting within the Polish population of cancer patients. The translation and implementation process and training of experienced palliative care medical staff proceeded without any particular difficulties. The team members reported that the PPSv2-Polish tool was clear and easy, although a bit time consuming to use in daily practice, and it required observation of a patient for a significant period of time (e.g. through a whole shift) to assess the potential capability of evaluated functions. When comparing various performance tools, it appears that no one is statistically superior to others in terms of inter-rater reliability [20]. The ECOG PS or KPS are often used in determining eligibility for clinical trials. However, there could be a substantial disagreement in the assessment of performance status between oncologists, even when using as simple a tool as the ECOG PS [21]. Patients’ age, preferences and socio-economic background may also influence the assessment. Numerous studies confirmed good correlations of KPS, ECOG PS, and PPS tools, and meta-analysis favors KPS as descriptively better [20]. Authors of the original version of the PPSv2 noticed that in contrary to the KPS, this scale does not focus on the need for hospitalization (which is of poor definability and does not help in defining performance) but instead assesses food/fluid intake and level of consciousness [2]. The ambiguity of the KPS assessment when patients were bedridden (KPS ≤ 40%) led to scale modification in Australia [22]. PPSv2 usage assumes a 5-step assessment, which can be problematic at the beginning, but after training may be more comprehensive and accurate. Both KPS and PPSv2 scales need standardized, appropriate instructions regarding performance evaluation. Compared with the 5-point ECOG PS, the 11-point PPSv2 seems to be a more precise tool, especially for lower performance statuses. This phenomenon was also affirmed in our observations, where the ECOG PS did not achieve significant reliability between the scoring of different types of professionals.

The high level of agreement with a very good correlation in serial scoring by one rater in a 2 days interval appeared better than in another study with 2 weeks between consecutive assessments [3]. The chosen interval of 2 days between assessments allowed for an optimal period not to recall the first scoring, yet not too long to allow changes in performance in most cases.

The excellent inter-rater concordance observed in this study was higher than in an updated meta-analysis recently published [20]. The explanation of this phenomenon partially could be explained by the careful inclusion of rating staff, who attended to patients for several hours daily and had a great understanding of their mobility and functionality [11].

The strength of this study was the high inter-rater agreement each time between different professionals (nurse, psychologist, or physiotherapist) took part in the assessment. There are inconsistencies in the evaluation of a patient’s performance status using the same tool by different types of professionals (doctors rated patients as healthier than nurses using the PPSv2 scale), and it may be explained by different amounts of time spent with the evaluated person [11]. However, even research asistants rated patients simillar to physicians (oncologists or radiation therapists) in one study [23]. Optimally, it should be advised to score patients within interdisciplinary team meetings to gain a more accurate assessment [24].

Our study legitimizes the usage of the PPSv2-Polish in prognostication of patients with advanced cancer, which is in line with previous studies [4, 7]. The strongest correlation between the PPSv2-Polish and survival time among the analysed tools was remarkable, and as to the best of our knowledge it was not published earlier. In another recent study of advanced cancer patients with prognosis in terms of weeks, the PPSv2 assessment was as accurate as subjective clinical survival predictions [25]. The similarity between the subjective prognosis assessment of the attending physician, expressed by GSF staging, and the PPSv2 scoring in our observations legitimizes the good responsiveness of this newly validated tool to patients’ changing prognosis and physical condition. This finding could be explained by the strong relationship between the hospice staff and the patient, as this factor was described to have an impact on accuracy [26].

This study was not without limitations. First, the majority of patients recruited presented a low performance status, were mostly sitting or bedridden, and were not representative for the whole palliative population. Secondly, only in-patient subjects were recruited and most of the unstable patients were excluded due to the test-retest requirements.

Conclusion

The Polish version of PPSv2 is a valid and reliable tool measuring performance status in a hospice population, which can be used in daily clinical practice in palliative care, research, and prognostication.

Availability of data and materials

The dataset used and analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

PPS:

Palliative Performance Scale

PPSv2:

Palliative Performance Scale Version 2

PPSv2-Polish:

Polish translation of the Palliative Performance Scale Version 2

KPS:

Karnofsky Performance Score

ECOG:

Eastern Cooperative Oncology Group

ECOG PS:

Eastern Cooperative Oncology Group Performance Status

Barthel ADL:

Barthel Activities of Daily Living Index

IQR:

Interquartile range

GSF:

Gold Standard Framework

References

  1. 1.

    Looney F, Cobbe S, Ryan A, Barriscale I, McMahon A, Real S. The search for a functional outcome measure for physical therapy in specialist palliative care: an ongoing journey. Rehabil Oncol 2020. doi:10.1097/01.REO.0000000000000194.

  2. 2.

    Anderson F, Downing GM, Hill J, Casorso L, Lerch N. Palliative performance scale (PPS): a new tool. J Palliat Care. 1996;12:5–11.

    CAS  Article  Google Scholar 

  3. 3.

    Ho F, Lau F, Downing MG, Lesperance M. A reliability and validity study of the palliative performance scale. BMC Palliat. Care. 2008;7:10.

    Article  Google Scholar 

  4. 4.

    Myers J, Kim A, Flanagan J, Selby D. Palliative performance scale and survival among outpatients with advanced cancer. Support Care Cancer. 2015;23:913–8.

    Article  Google Scholar 

  5. 5.

    Gold Standard Framework. https://www.goldstandardsframework.org.uk/cdcontent/uploads/files/General Files/Prognostic Indicator Guidance October 2011.pdf. Accessed 20 March 2020.

  6. 6.

    Leppert W, Forycka M, de Walden-Gałuszko K, Majkowicz M, Buss T. Quality of life assessment in cancer patients – recommendations for the staff of oncology and palliative care units. Psychoonkologia. 2014;1:17–29.

    Google Scholar 

  7. 7.

    Lau F, Downing GM, Lesperance M, Shaw J, Kuziemsky C. Use of palliative performance scale in end-of-life prognostication. J Palliat Med. 2006;9:1066–75.

    Article  Google Scholar 

  8. 8.

    Cha ES, Kim KH, Erlen JA. Translation of scales in cross-cultural research: issues and techniques. J Adv Nurs. 2007;58:386–95.

    Article  Google Scholar 

  9. 9.

    Karnofsky DA, Abelmann WH, Craver LF, Burchenal JH. The use of the nitrogen mustards in the palliative treatment of carcinoma. Cancer. 1948;1:634–56.

    Article  Google Scholar 

  10. 10.

    Péus D, Newcomb N, Hofer S. Appraisal of the Karnofsky performance status and proposal of a simple algorithmic system for its evaluation. BMC Med Inform Decis Mak. 2013;13:1.

    Article  Google Scholar 

  11. 11.

    Zimmermann C, Burman D, Bandukwala S, Seccareccia D, Kaya E, Bryson J, Rodin G, Lo C. Nurse and physician inter-rater agreement of three performance status measures in palliative care outpatients. Support Care Cancer. 2010;18:609–16.

    Article  Google Scholar 

  12. 12.

    Jang RW, Caraiscos VB, Swami N, Banerjee S, Mak E, Kaya E, Rodin G, Bryson J, Ridley JZ, Le LW, Zimmermann C. Simple prognostic model for patients with advanced Cancer based on performance status. J Oncol Pract. 2014;10:e335–41.

    Article  Google Scholar 

  13. 13.

    Oken M, Creech R, Tormey D, Horton J, Davis T, McFadden E, Carbone P. Toxicity and response criteria of the Eastern Cooperative Oncology Group. Am J Clin Oncol. 1982:649–56.

  14. 14.

    Roila F, Lupattelli M, Sassi M, Basurto C, Bracarda S, Picciafuoco M, Boschetti E, Milella G, Ballatori E, Tonato M, Del Favero A. Intra and interobserver variability in cancer patients’ performance status assessed according to Karnofsky and ECOG scales. Ann Oncol. 1991;2:437–9.

    CAS  Article  Google Scholar 

  15. 15.

    Taylor AE, Olver IN, Sivanthan T, Chi M, Purnell C. Observer error in grading performance status in cancer patients. Support Care Cancer. 1999;7:332–5.

    CAS  Article  Google Scholar 

  16. 16.

    Mahoney, Florence; W Barthel D Functional evaluation: the Barthel Index Md State Med J 1965; 14:56–61.

  17. 17.

    Collin C, Wade DT, Davies S, Horne V. The barthel ADL index: a reliability study. Disabil Rehabil. 1988;10:61–3.

    CAS  Google Scholar 

  18. 18.

    Wade DT, Collin C. The Barthel ADL index: a standard measure of physical disability. Int Disabil Stud. 1988;10:64–7.

    CAS  Article  Google Scholar 

  19. 19.

    Shamin T. Guidelines for developing, translating, and validating a questionnaire in perioperative and pain medicine. Saudi J Anesth. 2019;13:281.

    Article  Google Scholar 

  20. 20.

    Chow R, Zimmermann C, Bruera E, Temel J, Im J, Lock M. Inter-rater reliability in performance status assessment between clinicians and patients: a systematic review and meta-analysis. BMJ Support Palliat Care 2019. doi:10.1136/bmjspcare-2019-002080.

  21. 21.

    Datta SS, Ghosal N, Daruvala R, Chakraborty S, Shrimali RK, Van Zanten C, Parry J, Agrawal S, Atreya S, Sinha S, Chatterjee S, Gollins S. How do clinicians rate patient’s performance status using the ECOG performance scale? A mixed-methods exploration of variability in decision-making in oncology. Ecancermedicalscience. 2019;13:1–23.

    Google Scholar 

  22. 22.

    Abernethy AP, Shelby-James T, Fazekas BS, Woods D, Currow DC. The Australia-modified Karnofsky performance status (AKPS) scale: a revised scale for contemporary palliative care clinical practice [ISRCTN81117481]. BMC Palliat Care. 2005;4:1–12.

  23. 23.

    Campos S, Zhang L, Sinclair E, Tsao M, Barnes EA, Danjoux C, Sahgal A, Goh P, Culleton S, Mitera G, Chow E. The palliative performance scale: examining its inter-rater reliability in an outpatient palliative radiation oncology clinic. Support Care Cancer. 2009;17:685–90.

    Article  Google Scholar 

  24. 24.

    Kutner JS, Bryant LL, Beaty BL, Fairclough DL. Symptom distress and quality-of-life assessment at the end of life: the role of proxy response. J Pain Symptom Manag. 2006;32:300–10.

    Article  Google Scholar 

  25. 25.

    Hui D, Ross J, Park M, Dev R, Vidal M, Liu D, Paiva CE, Bruera E. Predicting survival in patients with advanced cancer in the last weeks of life: how accurate are prognostic models compared to clinicians’ estimates? Palliat Med. 2019;026921631987326.

  26. 26.

    Selby D, Chakraborty A, Lilien T, Stacey E, Zhang L, Myers J. Clinician accuracy when estimating survival duration: the role of the patient’s performance status and time-based prognostic categories. J Pain Symptom Manag. 2011;42:578–88.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable

Funding

None.

Author information

Affiliations

Authors

Contributions

The authors: TG and TD contributed equally to this manuscript. Conceptualization: TG, TD; Methodology: TG, TD; Tool translation TG, TD, MK; Data collection: TG; Formal analysis: TD, TG; Writing - review and editing: TG, TD, MK. All authors have read and approved the manuscript.

Corresponding author

Correspondence to Tomasz Gradalski.

Ethics declarations

Ethics approval and consent to participate

At the start of each patient evaluation, all hospice care team members confirmed verbally their consent to the researcher. The protocol for this non-experimental research study (including the participants verbal consent) was approved by the Bioethics Committee of the Medical University of Warsaw (AKBE/309/2019).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no conflicts of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Dzierżanowski, T., Gradalski, T. & Kozlowski, M. Palliative Performance Scale: cross cultural adaptation and psychometric validation for Polish hospice setting. BMC Palliat Care 19, 52 (2020). https://doi.org/10.1186/s12904-020-00563-8

Download citation

Keywords

  • Performance status
  • Scale
  • Validation
  • Hospice
  • Palliative