Skip to main content

The interRAI CHESS scale is comparable to the palliative performance scale in predicting 90-day mortality in a palliative home care population

Abstract

Background

Prognostic accuracy is important throughout all stages of the illness trajectory as it has implications for the timing of important conversations and decisions around care. Physicians often tend to over-estimate prognosis and may under-recognize palliative care (PC) needs. It is therefore essential that all relevant stakeholders have as much information available to them as possible when estimating prognosis.

Aims

The current study examined whether the interRAI Changes in Health, End-Stage Disease, Signs and Symptoms (CHESS) Scale is a good predictor of mortality in a known PC population and to see how it compares to the Palliative Performance Scale (PPS) in predicting 90-day mortality.

Methods

This retrospective cohort study used data from 2011 to 2018 on 80,261 unique individuals receiving palliative home care and assessed with both the interRAI Palliative Care instrument and the PPS. Logistic regression models were used to evaluate the relationship between the main outcome, 90-day mortality and were then replicated for a secondary outcome examining the number of nursing visits. Comparison of survival time was examined using Kaplan-Meier survival curves.

Results

The CHESS Scale was an acceptable predictor of 90-day mortality (c-statistic = 0.68; p < 0.0001) and was associated with the number of nursing days (c = 0.61; p < 0.0001) and had comparable performance to the PPS (c = 0.69; p < 0.0001). The CHESS Scale performed slightly better than the PPS in predicting 90-day mortality when combined with other interRAI PC items (c = 0.72; p < 0.0001).

Conclusion

The interRAI CHESS Scale is an additional decision-support tool available to clinicians that can be used alongside the PPS when estimating prognosis. This additional information can assist with the development of care plans, discussions, and referrals to specialist PC teams.

Peer Review reports

Background

The number of individuals with chronic progressive diseases such as cancer, organ failure, Alzheimer’s dementia, and chronic lung diseases is increasing worldwide. Each year, individuals with these types of chronic illnesses account for approximately 71% of all deaths[1, 2]. These individuals usually have long-term health issues before death and require specialized palliative care (PC) that adequately addresses their symptoms and needs[3].

Many serious illnesses tend to be quite complex, have a less predictable trajectory towards death and can therefore make it difficult to estimate prognosis[4, 5]. While there is debate about the relevance of prognosis to define the need for PC, it continues to play a role in clinical practice. In some countries, such as the US, prognosis is needed for determining hospice eligibility as individuals are only eligible for hospice if they have a prognosis of < 6 months to live[6]. A number of studies have found that clinicians tend to be overly optimistic in predicting survival times. A recent systematic review found that clinical accuracy of categorical estimates of survival ranged from 23% up to 78%, with prediction tending to be over-estimated by most clinicians[7].

There are tools to help improve prognostication, including the Palliative Performance Scale (PPS). The PPS, a modification of the Karnofsky Performance Scale is widely used in several countries (e.g., Canada, the US) as a tool to identify the needs for PC in a variety of health care settings (e.g., home care, long-term care, hospital, hospice) as the PPS has been found to be predictive of survival[8,9,10]. The PPS can be administered by nurses or physicians at any point during the illness trajectory and is based on five observable parameters, including the degree of ambulation, activity and extent of disease, ability to do self-care, food/fluid intake, and state of consciousness[11]. Since 2007 in Ontario, the PPS has been used for all outpatient cancer clinics or for individuals with cancer receiving care at home[12]. While some studies have shown the PPS to be a good predictor of morality in both cancer and non-cancer illnesses[8, 13,14,15], others have found it may have lower predictive validity for individuals with other life-limiting illnesses[16, 17].

In Ontario, the interRAI Palliative Care instrument (interRAI PC) is widely used among palliative home care clients[18]. interRAI is a not-for-profit network of over 140 clinicians, researchers, and policy experts from approximately 35 countries. interRAI’s research focuses on the development and application of standardized assessments to inform clinical, management, and policy decisions in populations with complex needs of all ages, including palliative care clients. The interRAI instruments have been shown to have strong reliability and validity, and they include a series of common items that are relevant in all health care settings[19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34]. The interRAI PC includes the Changes in Health, End-Stage Disease, Signs and Symptoms (CHESS) Scale, which was initially developed with individuals in complex continuing care (CCC) and was found to be a strong predictor of mortality in several studies[27, 29, 30, 35,36,37,38,39,40]. Its utility is not limited to cancer patients since it was shown to predict mortality in 11 neurological conditions in home care, long-term care and CCC settings[24] and it had better performance than the NYHA functional classification in heart failure[37]. However, its use in palliative home care has not been explored. Although the CHESS Scale has been found to be a valid predictor of mortality in a variety of populations in diverse settings, it is important to explore how well the scale works in predicting prognosis in a palliative home care population.

A recent study found that over a third of individuals receiving palliative home care in Ontario had a prognosis of more than six months to live, and while the majority had a cancer diagnosis (83%), both circulatory and musculoskeletal conditions were also highly prevalent[41]. Therefore, it is important to explore how well the CHESS Scale works in predicting prognosis in a heterogeneous palliative home care population. The main objective of the current study was to examine whether the CHESS Scale is a good predictor of mortality in a known palliative home care population and whether adding additional items and scales embedded within the interRAI PC assessment to the CHESS Scale could improve its ability to predict mortality. A secondary objective was to examine how the CHESS Scale compares with the PPS in predicting mortality and how it may be associated with days of nursing service use.

Methods

Study design

This retrospective cohort study utilized anonymized, secondary data collected using the interRAI PC assessment in Ontario. The interRAI PC is a comprehensive assessment instrument that identifies person-specific PC preferences, symptoms and needs to support clinicians in the care planning process[42]. The assessment includes roughly 250 items capturing key domains such as pain, physical symptoms, communication, prognosis, cognitive and physical functioning, mood, psychosocial well-being, and spirituality. Assessments are completed by trained care coordinators (e.g., registered nurses, social workers, and other allied health professionals) and are based on information from direct interviews and observations, available medical records, and discussions with the client, members of their health care team, and their informal care providers[43, 44]. Along with all of the information obtained from the person, their care providers, etc., care coordinators ultimately use their clinical judgement when determining a score for each item/scale. Assessors are not able to complete the assessment until all fields have been given a value, therefore missing data are virtually nonexistent. Once completed, data elements within the assessment automatically generate a series of health index scales (e.g., CHESS Scale, mood disturbance) that can be used to develop and evaluate care plans. Evidence of the validity and reliability of the interRAI PC instrument has been reported previously[43,44,45,46].

Sample

All interRAI PC assessments completed between 2011 and 2018 were included, representing the most recent data available for Ontario. Data collected prior to 2011 was part of the pilot implementation of the interRAI PC assessment in Ontario and was not included. Each client was assessed with both the interRAI PC assessment and also the PPS, which were both being routinely collected as part of normal clinical practice during this time period. For individuals with multiple assessments within this time frame, the first assessment in the data for each unique individual was used for analysis. This resulted in a total sample of 80,261 unique individuals. The project was reviewed and approved by the Research Ethics Board at the University of Waterloo (REB #:30173).

Measures

One of the six health index scales which is automatically generated upon completion of the assessment is the CHESS Scale. This scale includes 12 items used to measure health instability and identify those at risk of mortality, including a subjective rating of prognosis, change in capacity for decision making, change in activities of daily living (ADL) status, vomiting, peripheral edema, dyspnea, end-stage disease, weight loss, insufficient fluid intake, dehydration, decrease in food or fluid intake, and fluid output exceeds input. The scale ranges from zero (no health instability) to five (severe health instability) and has been shown to be a significant predictor of mortality. In post-acute settings, each one-point increase on the CHESS Scale is associated with a nearly two-fold increased risk of death[35].

The PPS ranges in 10% increments from 0 to 100%. A score of 0% indicates death, 10% indicates a totally bed-bound individual who is unable to do any activity and needs total assistance, and 100% indicates the person is able to carry on normal activities and to work without any special care. PPS scores are often stratified into three groups to identify changes in the individual’s condition, where scores of 70–100% are classified as stable, 40–60% as transitional and 10–30% as end-of-life[12, 47]. The PPS has been shown to be a predictor of mortality in a heterogeneous PC population, including care provided to individuals in the home, nursing home, hospital acute care setting and free-standing hospice units[8]. interRAI PC and PPS data were obtained from Ontario Health Shared Services (OHSS), the organization responsible for overseeing home care. The de-identified data were made available as part of an existing data sharing agreement between interRAI Canada and OHSS.

Outcomes

The main outcome of interest of the current study was 90-day mortality. Byrne et al. proposed a ninety-day mortality as the preferred outcome indicator for local analysis and public reporting[48]. Ninety-day mortality refers to death occurring within 90 days based on administrative records maintained by OHSS. For all PC clients, the administrative database includes discharge date (if applicable) and discharge disposition, which is typically death in palliative clients, but can also include discharge to hospital, long-term care facility or residential hospice. Time to death was used in survival models with censoring at 90 days for those who lived beyond 90 days after the assessment. Persons discharged for reasons other than death before 90 days were censored at the discharge date.

A secondary outcome of interest examined the association of nursing service visits. Nursing services were chosen as an example of home care services that would be responsive to clinical complexity. In the general long-stay home care population, access to nurses is limited mainly to post-acute care clients (e.g., for surgical wound care, IV medication administration). However, palliative home care clients in Ontario are more likely to receive nursing services as their level of clinical complexity increases[49]. Nursing service use was based on the frequency of services provided at the time of the interRAI PC assessment. The nursing service utilization variable was based on the number of nursing visits that occurred in the last seven days prior to the assessment date. Care coordinators have access to administrative records as a source of information about the use of publicly-funded services and they also obtain information from the person and family members about other services that may have been paid for privately. The interRAI PC item includes both publicly-funded and private pay nursing services.

Other measures

There are six other health index scales embedded within the interRAI PC assessment which are automatically generated upon completion of the assessment:

  1. 1.

    The Cognitive Performance Scale (CPS) is scored from zero to six and includes items on short-term memory, cognitive skills for daily decision making, independence in eating and expressive communication. The CPS has been validated against the Mini Mental State Exam (MMSE) and is correlated with the Montreal Cognitive Assessment (MoCA)[50].

  2. 2.

    The Activities of Daily Living (ADL) Short Form is scored from zero to 16 and includes items around personal hygiene, locomotion, toilet use and eating. Higher scores on the scale indicate a greater dependence on others to complete these ADLs[51].

  3. 3.

    The Instrumental ADL (IADL) Capacity Scale rates three IADLs (meal preparation, ordinary housework, and managing medications) on a scale from zero (independent) to six (total dependence on others). Higher scores on the scale represent greater difficulty in completing these tasks independently[23].

  4. 4.

    The Pressure Ulcer Risk Scale (PURS) is scored from zero to eight and includes items such as impaired bed mobility, weight loss, a history of unresolved pressure ulcers and bowel incontinence[52].

  5. 5.

    The Pain Scale is scored from zero (no pain/less than daily pain) to four (severe/daily pain) and has been validated against the Visual Analog Scale. The scale includes two items which capture both the frequency and intensity of pain[53].

  6. 6.

    The Depression Rating Scale (DRS) is a 14-point summative scale across seven items relating to mood and behavior. A score of three or higher has been found to be predictive of a clinical diagnosis of depression[54,55,56,57,58].

Analysis

Descriptive analyses of categorical variables were used to provide an overview of the socio-demographic characteristics of the study population using the chi-square statistic. Due to the large sample size and potential for type I error, unadjusted odds ratios (OR) and 95% confidence intervals (CI) were also generated to help identify statistically important differences between individuals who did and did not die within 90-days. Candidate independent variables that could be used in addition to the CHESS Scale were identified by examining the relationship between the PPS and interRAI PC items as well as those that have been identified in the existing literature as being potentially important. In addition to the CHESS Scale, a number of other interRAI PC items that were explored in relation to the PPS included age, sex, the other health index scales (ADL Short Form, IADL Capacity Scale, CPS, DRS, Pain Scale and PURS), fluctuating consciousness, fatigue, mode of nutritional intake and physical improvement potential (from the perspective of both the person and the caregiver). A Pearson correlation coefficient of 0.2 or greater was used to determine a small effect size. Since we were interested in exploring all meaningful correlations between interRAI PC items and the PPS, we chose a more conservative effect size of 0.2[59]. All of the candidate independent variables met this criterion except for the DRS and Pain Scale, which were therefore dropped from further analyses (Table 1).

Table 1 Pearson correlation coefficients of interRAI PC items in relation to the PPS

Mortality was treated as a binary variable with death within 90 days (yes/no) as the main dependent variable of interest. Logistic regression models were used to estimate odds ratios and obtain c statistics. The c statistic represents the area under the curve when plotting a receiver operating characteristic curve. It provides an estimate of the model’s ability to discriminate between outcomes (e.g., died yes/no). In addition, survival plots with Kaplan-Meier curves were used to compare mortality patterns for the PPS and CHESS Scale.

The modelling for mortality focused on a few comparisons of interest, including: (a) Model 1: the performance of the full versions of the PPS (0-100%); (b) tests of alternative cut-points for the PPS that have been proposed in the literature[12, 47] (e.g., Model 2: 70-100% vs. 10-39% vs. 40-69%; and Model 3: 70-100% vs. 10-49% vs. 50-69%; c) Model 4: CHESS Scale (0–5) on its own; and d) Model 5: model that includes the CHESS Scale and other interRAI PC covariates (listed above) associated with mortality. The odds ratios for Models 1 through 4 are unadjusted as we were interested in seeing how the various cut-points of the PPS and CHESS Scale influenced the outcome on their own. Only Model 5 shows adjusted odds ratios as it is adjusted for all variables included in the model. Although the odds ratios associated with the covariates examined provide information about the direction and magnitude of associations, the c statistic is of particular interest as a means of direct comparison of the relative performance of the PPS, CHESS Scale and a fuller model with additional covariates.

The final multivariable models were developed by examining bivariate odds ratios of potential covariates and then reduction of multivariate models to include only those that were significant at the 0.05 level. Models were reduced manually (rather than with automated stepwise procedures) and alternate models were tested to ensure order of entry/deletion effects did not occur. For variables that had potential problems with collinearity (e.g., ADL and pressure ulcers), alternative models were tested for each variable in question and the model with the best ability to discriminate based on the c-statistic[60] was retained if both variables were not significant.

We also examined nursing service use as a secondary outcome, which was defined as receipt of nursing visits on at least 3 of the last 7 days (yes/no). Our aim was to examine an additional proxy indicator of medical complexity with the assumption that factors associated with increased mortality risk would also drive increased use of nursing services. The five models listed above were replicated using receipt of nursing visits as the dependent variable to provide evidence of convergent validity that complements the evidence of predictive validity demonstrated in the relationship with mortality. All statistical analyses were done using SAS, version 9.4 (SAS Institute’s Inc.)[61]. The study followed the STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) guidelines[62].

Results

Table 2 provides an overview of bivariate associations with mortality. PC clients aged 85 years and older were more likely to die within 90 days compared to their younger counterparts (OR = 1.79; 95% CI: 1.63, 1.97). Clients that lived with their spouse/partner or lived with other relatives were more likely to die within 90 days compared to those living alone (OR = 1.33; CI: 1.27, 1.38 and OR = 1.38; CI: 1.32, 1.44). Females were less likely to die within this time frame (OR = 0.80; CI: 0.78, 0.83). Compared to those receiving in-patient hospice, individuals who were enrolled in any other type of palliative program (e.g., PC unit/bed, home hospice, outpatient PC) were all less likely to experience mortality within the last 90 days. With each increasing score on the CHESS Scale, the odds of dying within 90 days also increased. For example, compared to individuals with a CHESS score of 0, those with a score of 4 had a significantly increased odds of dying (OR = 11.54; CI: 10.03, 13.27), which further increased for those with a CHESS Scale score of 5 (OR = 18.05; CI: 15.64, 20.84). Similarly, individuals with lower PPS scores (i.e., worse functioning) were also significantly more likely to die compared to those with higher PPS scores (OR: 20.55; CI: 9.13, 46.23; Table 2).

Table 2 Characteristics of the study population (N = 80,261), stratified by mortality within 90 days (n = 29,682)

Comparing PPS and interRAI PC models to predict mortality

Table 3 shows logistic regression models based on the PPS and the interRAI PC to predict 90-day mortality. The full version of the PPS (Model 1) was found to be an acceptable predictor of mortality (c-stat = 0.69; p < 0.0001). When the PPS score was stratified into known cut-points suggested in the literature, the two models performed slightly worse than the full version of the PPS. For example, in Model 2 (70-100%, 10-39% and 40-69%), the model’s predictive ability was slightly less than the non-stratified PPS (Model 1; c-stat = 0.63 vs. 0.69). Similar results were also observed for Model 3 (70-100%, 10-49% and 50-69%; c-stat = 0.66 vs. c-stat of full PPS = 0.69). Model 4, performed similarly to the full PPS model (c-stat = 0.68 vs. 0.69). Finally, when the CHESS Scale was combined with additional interRAI PC items (e.g., age, ADL, IADL, nutritional intake, fluctuating consciences, fatigue, pain, and physical improvement potential; Model 5), the model was better at predicting 90-day mortality (c-stat = 0.72; p < 0.0001) compared to all PPS models (Models 1–3) and the model with CHESS on its own (Model 4). Within this model, the strongest predictors of survival were the CHESS score, age, and mode of nutritional intake (Table 3).

Table 3 Logistic regression analysis assessing models to predict mortality within 90 days in palliative home care clients

The Kaplan-Meier survival curves stratified by the collapsed version of the PPS (40% and 70% cut-offs) and the CHESS Scale are shown in Figs. 1 and 2, respectively. Individuals with a PPS score of 70–100% had a 90-day survival probability of 84%, while the probability for those with a PPS score of 40-69% was 59%, which dropped to 31% for individuals in the lowest PPS cut-off (long-rank test < 0.0001; Fig. 1). The probability of survival to 90 days for a CHESS Scale score of 0 was 92%, which dropped to 65% for those with a score of 3 and went down to 38% for individuals with a CHESS Scale score of 5. For every one-point increase on the CHESS Scale, there was a nearly two-fold increased risk of mortality within 90-days (log-rank test < 0.0001; Fig. 2).

Fig. 1
figure 1

Survival estimates among palliative home care clients in Ontario based on the Palliative Performance Scale (PPS)

Fig. 2
figure 2

Survival estimates among palliative home care clients in Ontario based on the interRAI CHESS Scale

Comparing PPS and interRAI PC models and its association with the number of nursing days

Table 4 presents logistic regression models based on the PPS and the interRAI PC to examine the association with the number of nursing days in palliative home care clients. The five models that were used to predict mortality were replicated to see if they were also associated with the number of nursing days. The full PPS model (Model 1) had the strongest association when examining the number of nursing days compared to all other models (c-stat = 0.69, p < 0.0001)Footnote 1. The collapsed versions of the PPS (Models 2 and 3) performed worse than the full model (PPS cut-points 10% and 40%: c-stat = 0.61; p < 0.0001; PPS cut-points 10% and 50%: c-stat = 0.64; p < 0.0001). Model 4 which used the CHESS Scale had the lowest c-statistic of all models (c-stat = 0.61; p < 0.0001), while the model combining the CHESS Scale with other interRAI PC items performed better than both the collapsed versions of the PPS (c-stat = 0.68; p < 0.0001; Table 4).

Table 4 Logistic regression analysis assessing models associated with the receipt of nursing visits in palliative home care clients

Discussion

The interRAI CHESS Scale has been found to be a very good predictor of mortality in a variety of settings, including complex continuing care, home care and long-term care. In the current study, we found that the CHESS Scale is an acceptable predictor of mortality in a heterogeneous palliative home care population. With each one-point increase on the CHESS Scale, there was a nearly two-fold increased risk of mortality within 90-days. Additionally, the results of the current study show that the CHESS Scale is comparable to the PPS in predicting 90-day mortality. This was especially true when the CHESS Scale was combined with other items from the interRAI PC, including age, sex, ADLs, IADLs, nutritional intake, fluctuating consciousness, fatigue, pain, and physical improvement potential. When combined, this model performed slightly better, in terms of discrimination, than the PPS.

The interRAI PC CHESS Scale and other assessment items were also associated with clinical resource use and are therefore informative for analyses related to costs of palliative home care[49]. Performance was comparable to the un-collapsed version of the PPS and notably better than the collapsed alternatives.

Most prognostic tools have been developed to identify individuals who are imminently or actively dying, and have typically focused on those with a cancer diagnosis[63, 64]. The “surprise question” (“Would you be surprised if the person died in the next 12 months”)[65] has often been used to identify individuals eligible for PC services, although recent data have shown that it is not particularly accurate at identifying individuals near the end-of-life[66]. There are a number of other prognostic tools that have been developed for use in both the hospital and community setting[67, 68]. However, the CHESS Scale is more advantageous as it has been shown to predict mortality in a number of heterogeneous populations, including those in home care, long-term care and CCC settings. A recent study examining the trajectory of end-of-life pain and other physical symptoms in individuals with cancer found that the CHESS Scale continually increased during the last two months of life and identified 50% of the cohort with high health instability in the last weeks of life[69]. The CHESS Scale has also been used to predict mortality in individuals with other non-cancer diagnoses, which is beneficial over other disease-specific tools, as this allows for direct comparisons across various diagnostic groups[24].

The CHESS Scale is a decision support tool that is available to clinicians when they complete a number of interRAI instruments (e.g., home care, long-term care), to inform shared decision-making. The interRAI Home Care (HC) assessment is currently being used in 20 other countries besides Canada. This allows for HC clinicians to gain some insight into the mortality risk for individuals with a life-limiting illness, even if they have not been identified as eligible for palliative care. Additionally, given its ability to predict mortality, the CHESS Scale can help clinicians decide when to initiate discussions around advance care planning with the individual and their family. For regions that do not currently use the PPS on a regular basis, but are routinely using an interRAI assessment, the CHESS Scale can be calculated and provide information about mortality risk similar to the PPS. The interRAI suite of assessments are used widely in Canada and internationally, therefore the CHESS Scale represents an efficient way to predict mortality without administering additional assessments, thereby potentially reducing assessment burden for individuals and their families.

Home-based palliative nursing care at the end-of-life typically focuses on alleviating distressing symptoms for the individual and their family and ensuring optimal quality of life. When these services are delivered early in the illness trajectory, it has been shown to reduce late-life health service use (i.e., hospital admissions)[63]. We found that the PPS, CHESS Scale, and other interRAI PC items were associated with increased odds of use of home nursing services, which are infrequently provided to other home care clients in Canada[39]. This suggests that the interRAI PC could also be used to predict clinical resource use[49] and it could service as a decision support tool to identify persons with complex needs who may be under-served with nursing services.

Prognosis has typically been used as the benchmark for when to initiate PC and PC services, and while it is important, it should not be the sole determinant of when to initiate PC. The care needs of both the individual and their family should also be considered when discussing the initiation of PC. PC can begin at the time of diagnosis and can be provided in conjunction with curative treatments. Having access to PC services early in the course of the illness can facilitate care planning, which helps ensure that care is in line with the preferences of both the individual and their family[70, 71]. Additionally, early PC can enable appropriate referrals to specialist PC services, which have been shown to improve mood, assist with advance care planning, reduce health care utilization and improve overall quality of life[72].

An additional use of the CHESS Scale and other interRAI measures is for the specification of reassessment intervals in palliative care. In order to track clinical outcomes and to adjust care plans in response to changing health needs, reassessments should occur on a timely basis. In long-stay home care clients, the recommended reassessment interval is six months. However, this would be too long for most palliative clients in the community. CHESS scores and other interRAI PC indicators could be used proactively to schedule the reassessment cycle to ensure that the needs of palliative clients are met on an ongoing basis.

Future research with these data will focus on the development of palliative-specific variants of the CHESS Scale that employ more items from the interRAI PC into a single composite measure of mortality risk and clinical complexity. In addition, we will explore the use of the CHESS Scale and other interRAI PC measures to develop palliative specific case-mix classification systems that can be used for resource allocation.

There are several strengths in the current study, including the large sample size, which represents most regions in Ontario as the majority are using the interRAI PC assessment for individuals receiving palliative home care. Additionally, while this paper focuses on PC data, the CHESS Scale can also be calculated using other interRAI instruments that are in widespread use internationally. A potential limitation is that the data were limited to individuals receiving PC in Ontario only, as no other provinces or territories in Canada are currently using the interRAI PC assessment. However, other countries such as New Zealand have implemented the interRAI PC assessment nationally, which will allow for cross-national comparisons to be made in the future. Finally, we chose to utilize the first available assessment within the data for each unique individual, which may not have captured the most current situation for each person. We felt it was important to include the first assessment for everyone as this likely represents the beginning of the receipt of palliative home care services for these individuals.

Conclusion

The interRAI CHESS Scale was an acceptable predictor of mortality in a palliative home care population with comparable performance to the PPS. The CHESS Scale is available on most interRAI instruments, which are widely used across Canada and globally. Having access to this important-decision support tool in multiple sectors of the health care system (e.g., home care, long-term care, etc.), allows for the potential for individuals with serious and life-limiting illnesses to be identified earlier. This provides clinicians with upstream information to assist with care planning, timing of when to initiate PC and conversations around advance care planning. Having these conversations early on and throughout the illness trajectory can optimize the quality of care being provided to the individual and their family.

Data Availability

The data are not publicly available, but they are directly available to interRAI fellows and their staff and students. Other researchers can access the data from the Canadian Institute for Health Information for researchers who meet the criteria for access to confidential data. These data represent third party data that are not owned nor collected by the study authors. A data request form can be found here: https://www.cihi.ca/en/access-data-and-reports/make-a-data-request.

Notes

  1. Note that model 1 uses PPS = 10 as the reference group due to cell size limitations for PPS = 100. This results in inverse Odds Ratios to those shown in Models 2 to 4.

References

  1. Kuluski K, Ho JW, Hans PK, Nelson M. Community care for people with complex care needs: bridging the gap. Int J Integr Care. 2017;17(4):1–11.

    Article  Google Scholar 

  2. Canadian Hospice Palliative Care Association. Fact Sheet: Hospice Palliative Care in Canada. 2013. p. 1–16.

  3. Koller D, Schön G, Schäfer I, Glaeske G, van den Bussche H, Hansen H. Multimorbidity and long-term care dependency: a five-year follow-up. BMC Geriatr. 2014;14:70.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Downar J, Wegier P, Tanuseputro P. Early Identification of People Who Would Benefit From a Palliative Approach—Moving From Surprise to Routine. JAMA Netw open. 2019;2(9):e1911146-e.

    Article  Google Scholar 

  5. Ontario Palliative Care Network. Tools to support earlier identification for palliative care. Toronto: Ontario Palliative Care Network; 2019.

    Google Scholar 

  6. Mitchell A, Kiely L, Hamel DK, Park MB, Morris PS, Fries JN. BE. Estimating prognosis for nursing home residents with advanced dementia. American Medical Association. 2004;291(22).

  7. White N, Reid F, Harris A, Harries P, Stone P, Pulenzas A. A systematic review of predictions of survival in palliative care: how accurate are clinicians and who are the experts? PLoS ONE. 2016;11(8):e0161407.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Lau F, Downing M, Lesperance M, Karlson N, Kuziemsky C, Yang J. Using the Palliative Performance Scale to provide meaningful survival estimates. J Pain Symptom Manag. 2009;38(1):134–44.

    Article  Google Scholar 

  9. Ollajide O, Hanson L, Usher BM, Qaqish BF, Schwartz R, Bernard S. Validation of the Palliative Performance Scale in the acute tertiary care hospital setting. J Palliat Med. 2007;10(1):111–7.

    Article  Google Scholar 

  10. Ho F, Lau F, Downing MGL. M. A reliability and validity study of the Palliative Performance Scale. BMC Palliat care. 2008;7(10):1–10.

    Google Scholar 

  11. Anderson F, Downing MG, Hill J. Palliative Performance Scale (PPS): a new tool. J Palliat Care. 1996;12(1):5–11.

    Article  CAS  PubMed  Google Scholar 

  12. Barbera L, Seow H, Howell D, Sutradhar R, Earle C, Liu Y, et al. Symptom burden and performance status in a population-based cohort of ambulatory cancer patients. Cancer. 2010;116(24):5767–76.

    Article  PubMed  Google Scholar 

  13. Harrold J, Rickerson E, Carroll JT, McGrath J, Morales K, Kapo J, et al. Is the Palliative Performance Scale a useful predictor of mortality in a heterogenous hospice population? J Palliat Med. 2005;8(3):503–9.

    Article  PubMed  Google Scholar 

  14. McGreevy CM, Bryczkowski S, Pentakota SR, Berlin A, Lamba S, Mosenthal AC. Unmet palliative care needs in elderly trauma patients: can the Palliative Performance Scale help close the gap? Am J Surg. 2017;213(4):778–84.

    Article  PubMed  Google Scholar 

  15. Masterson Creber R, Russell D, Dooley F, Jordan L, Baik D, Goyal P, et al. Use of the Palliative Performance Scale to estimate survival among home hospice patients with heart failure. ESC Heart Failure. 2019;6(2):371–8.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Prompantakorn P, Angkurawaranon C, Pinyopornpanish K, Chutarattanakul L, Aramrat C, Pateekhum C, et al. Palliative Performance Scale and survival in patients with cancer and non-cancer diagnoses needing a palliative care consultation: a retrospective cohort study. BMC Palliat Care. 2021;20(1):74.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Head B, Ritchie CS, Smoot TM. Prognostication in hospice care: can the palliative performance scale help? J Palliat Med. 2005;8(3):492–502.

    Article  PubMed  Google Scholar 

  18. Hirdes JP. Addressing the health needs of frail elderly people: Ontario’s experience with an integrated health information system. Age Ageing. 2006;35(4):329–31.

    Article  PubMed  Google Scholar 

  19. Poss JW, Jutan NM, Hirdes JP, Fries BE, Morris JN, Teare GF, et al. A review of evidence on the reliability and validity of Minimum Data Set data. Healthc Manage Forum. 2008;21(1):33–9.

    Article  CAS  PubMed  Google Scholar 

  20. Hirdes JP, Ljunggren G, Morris JN, Frijters DH, Finne-Soveri H, Gray L, et al. Reliability of the interRAI suite of assessment instruments: A 12-country study of an integrated health information system. BMC Health Services Research. 2008;8.

  21. Foebel AD, Hirdes JP, Heckman GA, Kergoat MJ, Patten S, Marrie RA, et al. Diagnostic data for neurological conditions in interRAI assessments in home care, nursing home and mental health care settings: a validity study. BMC Health Serv Res. 2013;13:457.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Morris JN, Fries BE, Steel K, Ikegami N, Bernabei R, Carpenter I, et al. Comprehensive clinical assessment in community setting: applicability of the MDS-HC. J Am Geriatr Soc. 1997;45(8):1017–24.

    Article  CAS  PubMed  Google Scholar 

  23. Landi F, Tua E, Onder G, Carrara B, Sgadari A, Rinaldi C, et al. Minimum Data Set for Home Care: A valid instrument to assess frail older people living in the community. Med Care. 2000;38(12):1184–90.

    Article  CAS  PubMed  Google Scholar 

  24. Hirdes JP, Poss JW, Mitchell L, Korngut L, Heckman G. Use of the interRAI CHESS scale to predict mortality among persons with neurological conditions in three care settings. PLoS ONE. 2014;9(6):e99066.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Armstrong JJ, Stolee P, Hirdes JP, Poss JW. Examining three frailty conceptualizations in their ability to predict negative outcomes for home-care clients. Age Ageing. 2010;39(6):755–8.

    Article  PubMed  Google Scholar 

  26. Hirdes JP, Poss JW, Caldarelli H, Fries BE, Morris JN, Teare GF, et al. An evaluation of data quality in Canada’s continuing care reporting system (CCRS): secondary analyses of ontario data submitted between 1996 and 2011. BioMed Cent. 2013;13(1):27.

    Google Scholar 

  27. Heckman GA, Hirdes JP, Hebert PC, Morinville A, Amaral A, Costa A, et al. Predicting Future Health Transitions Among Newly Admitted Nursing Home Residents With Heart Failure. Journal of the American Medical Directors Association; 2018.

  28. Hogeveen SE, Chen J, Hirdes JP. Evaluation of data quality of interRAI assessments in home and community care. BMC Med Inf Decis Mak. 2017;17(1):150.

    Article  Google Scholar 

  29. Hjaltado’ttir I, Hallberg IR, Ekwall AK, Nyberg P. Predicting mortality of residents at admission to nursing home: a longitudinal cohort study. BMC Health Serv Res. 2011;11:86.

    Article  Google Scholar 

  30. Lee JS, Chau PP, Hui E, Chan F, Woo J. Survival prediction in nursing home residents using the Minimum Data Set subscales: ADL Self-Performance Hierarchy, Cognitive Performance and the Changes in Health, End-stage disease and Symptoms and Signs scales. Eur J Pub Health. 2009;19(3):308–12.

    Article  Google Scholar 

  31. Hirdes JP, van Everdingen C, Ferris J, Franco-Martin M, Fries BE, Heikkilä J, et al. The interRAI suite of mental health assessment instruments: An integrated system for the continuum of care. Frontiers in Psychiatry. 2020;10.

  32. Gray LC, Berg K, Fries BE, Henrard JC, Hirdes JP, Steel K, et al. Sharing clinical information across care settings: the birth of an integrated assessment system. BioMed Cent Health Serv Res. 2009;9(71):1–10.

    Google Scholar 

  33. Stewart SL, Celebre A, Semovski V, Hirdes JP, Vadeboncoeur C, Poss JW. The interRAI Child and Youth Suite of Mental Health Assessment Instruments: An Integrated Approach to Mental Health Service Delivery. Front Psychiatry. 2022;13:1–27.

    Article  CAS  Google Scholar 

  34. Lynch-Godrei A, Doherty M, Vadeboncoeur C. interRAI Pediatric Home Care (PEDS-HC) Assessment Tool: Evaluating Ontario Healthcare Workers’ Experience. Health Serv Insights. 2022;15:1–3.

    Google Scholar 

  35. Hirdes J, Frijters DH, Teare GF. The MDS-CHESS scale: a new measure to predict mortality in institutionalized older people. J Am Geriatr Soc. 2003;51(1):96–100.

    Article  PubMed  Google Scholar 

  36. Hirdes JP, Heckman GA, Morinville A, Costa A, Jantzi M, Chen J, et al. One Way Out? A Multistate Transition Model of Outcomes After Nursing Home Admission. Journal of the American Medical Directors Association; 2019.

  37. Tjam EY, Heckman GA, Smith S, Arai B, Hirdes J, Poss J, et al. Predicting heart failure mortality in frail seniors: comparing the NYHA functional classification with the Resident Assessment Instrument (RAI) 2.0. Int J Cardiol. 2012;155(1):75–80.

    Article  PubMed  Google Scholar 

  38. Heckman GA, Hirdes JP, Hebert P, Costa A, Onder G, Declercq A, et al. Assessments of Heart Failure and Frailty-Related Health Instability Provide Complementary and Useful Information for Home-Care Planning and Prognosis. Can J Cardiol. 2021;37(11):1767–74.

    Article  PubMed  Google Scholar 

  39. Sinn CJ, Sultan H, Turcotte LA, McArthur C, Hirdes JP. Patterns of home care assessment and service provision before and during the COVID-19 pandemic in Ontario, Canada. PLoS ONE. 2022;17(3):e0266160.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  40. Sinn CJ, Heckman G, Poss JW, Onder G, Vetrano DL, Hirdes J. A comparison of 3 frailty measures and adverse outcomes in the intake home care population: a retrospective cohort study. CMAJ Open. 2020;8(4):E796–809.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Williams N, Hermans K, Stevens T, Hirdes JP, Declercq A, Cohen J, et al. Prognosis does not change the landscape: palliative home care clients experience high rates of pain and nausea, regardless of prognosis. BMC Palliat care. 2021;20(1):165.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Freeman S, Hirdes JP, Stolee P, Garcia J, Smith TF, Steel K, et al. Care planning needs of palliative home care clients: Development of the interRAI palliative care assessment clinical assessment protocols (CAPs). BMC Palliat Care. 2014;13(1):58.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Steel K, Ljunggren G, Topinkova E, Morris JN, Vitale C, Parzuchowski J, et al. The RAI-PC: an assessment instrument for palliative care in all settings. Am J Hospice Palliat Care. 2003;20(3):211–9.

    Article  CAS  Google Scholar 

  44. Hirdes JP, Ljunggren G, Morris JN, Frijters DH, Finne-Soveri H, Gray L, et al. Reliability of the interRAI suite of assessment instruments: a 12-country study of an integrated health information system. BMC Health Serv Res. 2008;8(277):1–11.

    Google Scholar 

  45. Hermans K, Spruytte N, Cohen J, Van Audenhove C, Declercq A. Usefulness, feasibility and face validity of the interRAI Palliative Care instrument according to care professionals in nursing homes: A qualitative study. Int J Nurs Stud. 2016;62:90–9.

    Article  PubMed  Google Scholar 

  46. Hirdes JP, Morris JN, Perlman CM, Saari M, Betini GS, Franco-Martin MA, et al. Mood Disturbances Across the Continuum of Care Based on Self-Report and Clinician Rated Measures in the interRAI Suite of Assessment Instruments. Front Psychiatry. 2022;13:1–16.

    Article  Google Scholar 

  47. Dudgeon DJ, Knott C, Chapman C, Coulson K, Jeffery E, Preston S, et al. Development, implementation, and process evaluation of a regional palliative care quality improvement project. J Pain Symptom Manag. 2009;38(4):483–95.

    Article  Google Scholar 

  48. Byrne BE, Mamidanna R, Vincent CA, Faiz O. Population-based cohort study comparing 30- and 90-day institutional mortality rates after colorectal surgery. Br J Surg. 2013;100(13):1810–7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  49. Cheng C. Predictors of Palliative Home Care Costs in Ontario, Canada. Waterloo: University of Waterloo; 2021.

    Google Scholar 

  50. Jones K, Perlman CM, Hirdes J, Scott T. Screening cognitive performance with the resident assessment instrument for mental health cognitive performance scale. Can J Psychiatry. 2010;55(11):736–40.

    Article  PubMed  Google Scholar 

  51. Morris JN, Fries BE, Morris SA. Scaling ADLs within the MDS. Journals of Gerontology Series A, Biological Sciences and Medical Sciences. 1999;54A(11):M546-M53.

  52. Poss J, Murphy KM, Woodbury MG, Orsted H, Stevenson K, Williams G, et al. Development of the interRAI Pressure Ulcer Risk Scale (PURS) for use in long-term care and home care settings. BMC Geriatr. 2010;10(1):67.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Fries BE, Simon SE, Morris JN, Flodstrom C, Bookstein FL. Pain in US nursing homes: validating a pain scale for the Minimum Data Set. Gerontologist. 2001;41(2):173–9.

    Article  CAS  PubMed  Google Scholar 

  54. Martin L, Poss JW, Hirdes JP, Jones RN, Stones MJ, Fries BE. Predictors of a new depression diagnosis among older adults admitted to complex continuing care: implications for the Depression Rating Scale (DRS). Age Ageing. 2008;37(1):51–6.

    Article  PubMed  Google Scholar 

  55. Szczerbinska K, Hirdes JP, Zyczkowska J. Good news and bad news: depressive symptoms decline and undertreatment increases with age in home care and insitutional settings. Am J Geriatric Psychiatry. 2012;20(12):1045–55.

    Article  Google Scholar 

  56. Fisher KA, Seow H, Brazil K, Smith TF, Guthrie DM. Dimensionality, reliability and validity of the interRAI depression rating scale in a Canadian palliative care population. Soc Indic Res. 2015;118(1):1–18.

    Article  Google Scholar 

  57. Hirdes JP, Freeman S, Smith TF, Stolee P. Predictors of caregiver distress among palliative home care clients in Ontario: evidence based on the interRAI Palliative Care. Palliat Supportive Care. 2012;10(3):155–63.

    Article  Google Scholar 

  58. Freeman S, Smith TF, Neufeld E, Fisher K, Ebihara S. The wish to die among palliative home care clients in Ontario, Canada: A cross-sectional study. BMC Palliat Care. 2016;15:24.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Yang D, Dalton JE. A unified approach to measuring the effect size between two groups using SAS. Cleveland: SAS Institute, Inc.; 2012.

    Google Scholar 

  60. Pencina MJ, D’Agostino Sr RB. Evaluating Discrimination of Risk Prediction Models. The C Statistic. JAMA. 2015;314(10):1063–4.

    Article  CAS  PubMed  Google Scholar 

  61. SAS Institute Inc. SAS System for Windows. 9.4 ed. Carey: SAS Institute, Inc.; 2016.

    Google Scholar 

  62. von Elm E, Egger M, Altman DG, Pocock SJ, Gotzsche PC, Vandenbroucke JP. Strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. BMJ. 2007;335:806–8.

    Article  Google Scholar 

  63. Seow H, O’Leary E, Perez R, Tanuseputro P. Access to palliative care by disease trajectory: a population-based cohort of Ontario decedents. BMJ open. 2018;8(e021147):1–9.

    Google Scholar 

  64. Amblas-Novellas J, Murray SA, Espaulella J, Martori JC, Oller R, Martinez-Munoz M, et al. Identifying patients with advanced chronic conditions for a progressive palliative care approach: a cross-sectional study of prognostic indicators related to end-of-life trajectories. BMJ Open. 2016;6(9):e012340.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  65. Moss A, Lunney J, Culp S, Abraham J. Prognostic Significance of the Surprise Question in Cancer Patients. J Pain Symptom Manag. 2010;39(2):346.

    Article  Google Scholar 

  66. Ouchi K, Strout T, Haydar S, Baker O, Wang W, Bernacki R, et al. Association of Emergency Clinicians’ Assessment of Mortality Risk With Actual 1-Month Mortality Among Older Adults Admitted to the Hospital. JAMA Netw Open. 2019;2(9):e1911139.

    Article  PubMed  PubMed Central  Google Scholar 

  67. Wegier P, Koo E, Ansari S, Kobewka D, O’Connor E, Wu P, et al. mHOMR: a feasibility study of an automated system for identifying inpatients having an elevated risk of 1 - year mortality. BMJ Qual Saf. 2019;28:971–9.

    PubMed  Google Scholar 

  68. Hsu AT, Manuel DG, Spruin S, Bennett C, Taljaard M, Beach S, et al. Predicting death in home care users: derivation and validation of the Risk Evaluation for Support: Predictions for Elder-Life in the Community Tool (RESPECT). CMAJ. 2021;193(26):E997–1005.

    Article  PubMed  PubMed Central  Google Scholar 

  69. Seow H, Guthrie DM, Stevens T, Barbera LC, Burge F, McGrail K, et al. Trajectory of end-of-life pain and other physical symptoms among cancer patients receiving home care. Curr Oncol. 2021;28:1641–51.

    Article  PubMed  PubMed Central  Google Scholar 

  70. Temel JS, Greer JA, Muzikansky A, Gallagher ER, Admane S, Jackson VA, Dahlin CM, Blinderman CD, Jacobsen J, Pirl WF, Billings JA, Lynch TJ. Early palliative care for patients with metastatic non-small-cell lung cancer. N Engl J Med. 2010;363(8):733–42.

    Article  CAS  PubMed  Google Scholar 

  71. Hutt E, Da Silva A, Bogart E, Le Lay-Diomande S, Pannier D, Delaine-Clisant S, et al. Impact of early palliative care on overall survival of patients with metastatic upper gastrointestinal cancers treated with first-line chemotherapy: a randomised phase III trial. BMJ Open. 2018;8(1):1–6.

    Article  Google Scholar 

  72. Salins N, Ramanjulu R, Patra L, Deodhar J, Muckaden MA. Integration of Early Specialist Palliative Care in Cancer Care and Patient Related Outcomes: A Critical Review of Evidence. Indian J Palliat Care. 2016;22(3):252–7.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors would like to thank Health Shared Services Ontario for providing the interRAI Palliative Care (PC) and Palliative Performance Scale (PPS) data that were required to conduct this study. Additionally, the authors would also like to thank the Research Foundation-Flanders (FWO) for allocating funding that enabled the collaboration between the different international research partners.

Funding

This work was supported by a grant from the Canadian Institutes of Health Research [CIHR grant number: 156359].

Author information

Authors and Affiliations

Authors

Contributions

KH, JH, AD, JC, and DG contributed to the conception and design of the study. KH, JH, and NW analyzed the data, while KH, JH, AD, JC, AJ, JD, DG, and NW contributed to the interpretation of the data. NW and KH drafted the manuscript and all authors read and approved the final manuscript.

Corresponding author

Correspondence to Nicole Williams.

Ethics declarations

Ethics approval and consent to participate

The project was reviewed and approved by the Research Ethics Board at the University of Waterloo (REB #30173), and all methods were performed in accordance with the relevant guidelines and regulations. The research team is not involved in data collection, and we do not know the details of what participants are told at the time about how their data might be used in the future (e.g., research purposes). We do not know the actual process involved in obtaining informed consent as the province has their own protocols in place for client consent as the assessments are completed as part of normal clinical practice. These assessments are mandated or recommended for use by the province and those collecting the data would have to follow the policies laid out by the ministry of health. All identifying client information is de-identified prior to being shared with the research team.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Williams, N., Hermans, K., Cohen, J. et al. The interRAI CHESS scale is comparable to the palliative performance scale in predicting 90-day mortality in a palliative home care population. BMC Palliat Care 21, 174 (2022). https://doi.org/10.1186/s12904-022-01059-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12904-022-01059-3

Keywords