Skip to main content

The Prognosis in Palliative care Study II (PiPS2): study protocol for a multi-centre, prospective, observational, cohort study

A Correction to this article was published on 03 November 2018

This article has been updated

Abstract

Background

More accurate methods of prognostication are likely to lead to improvements in the quality of care of patients approaching the ends of their lives. The Prognosis in Palliative care Scales (PiPS) are prognostic models of survival. The scores are calculated using simple clinical data and observations. There are two separate PiPS models; PiPS-A for patients without blood test results and PiPS-B for patients with blood test results. Both models predict whether a patient is likely to live for “days”, “weeks” or “months” and have been shown to perform as well as clinicians’ estimates of survival. PiPS-B has also been found to be significantly better than doctors’ estimates of survival. We report here a protocol for the validation of PiPS and for the evaluation of the accuracy of other prognostic tools in a new, larger cohort of patients with advanced cancer.

Methods

This is a national, multi-centre, prospective, observational cohort study, aiming to recruit 1778 patients via palliative care services across England and Wales. Eligible patients have advanced, incurable cancer and have recently been referred to palliative care services. Patients with or without capacity are included in the study.

The primary outcome is the accuracy of PiPS predictions and the difference in accuracy between these predictions and the clinicians’ estimates of survival; with PiPS-B being the main model of interest. The secondary outcomes include the accuracy of predictions by the Palliative Prognostic Index (PPI), Palliative Performance Scale (PPS), Palliative Prognostic score (PaP) and the Feliu Prognostic Nomogram (FPN) compared with actual patient survival and clinicians’ estimates of survival.

A nested qualitative sub-study using face-to-face interviews with patients, carers and clinicians is also being undertaken to assess the acceptability of the prognostic models and to identify barriers and facilitators to clinical use.

Discussion

The study closed to recruitment at the end of April 2018 having exceeded the required sample size of 1778 patients. The qualitative sub-study is nearing completion. This demonstrates the feasibility of recruiting large numbers of participants to a prospective palliative care study.

Trial registration

ISRCTN13688211 (registration date: 28/06/2016).

Peer Review reports

Background

Patients approaching the ends of their lives, their relatives and clinicians all value accurate prognostic information [1,2,3,4,5]. This information is routinely provided by clinicians using their clinical intuition. However, clinicians’ estimates of survival (CES) are often inaccurate and over-optimistic [6]. The need for more accurate methods of prognostication was highlighted by the Neuberger report [7] into the short-comings of the implementation of the Liverpool Care Pathway [8].

Determining more accurately how long patients with advanced cancer have left to live would enable both patients and their relatives to make plans for their future [3]. It would also aid clinicians to target treatments to those patients most likely to benefit and it would safeguard other patients from receiving treatments that they are unlikely to benefit from [9]. Prognostic information may help clinicians to plan services and to ensure that patients are cared for in the most appropriate environment. More reliable prognostic estimates may also facilitate the identification of patients for inclusion on palliative care registers [10] and the prioritisation of patients who are referred to palliative care services.

The Prognosis in Palliative care Scales (PiPS) are predictive models of survival and were previously developed by members of our research team in order to provide an objective aid to clinicians’ intuition [9]. The original study recruited prospectively a cohort of 1018 patients with advanced cancer, who were no longer undergoing disease-modifying treatment. This was a multi-centre study involving 18 specialist palliative care services across England. Separate prognostic models were created for patients without (PiPS-A) or with (PiPS-B) available blood test results. The PiPS scores were able to predict whether a patient was likely to live for “days” (less than 14 days), “weeks” (between 2 and 7 weeks) or “months” (2 months or longer). These categories were chosen as they seemed to have the greatest face validity among clinicians. Both PiPS models were shown to perform as well as CES. The PiPS-B prognostic estimate was found to be significantly better than doctors’ prognostic estimates. Before recommending PiPS for use in routine clinical practice, it is important to check that the models provide accurate and reliable estimates of survival in a new group of patients.

More recently, two research studies have published validation data about the PiPS models [11, 12] in different clinical settings. Baba and colleagues (2015) [11] undertook an independent validation of the PiPS models in Japanese cancer patients and reported that the PiPS instrument performed as well as in Gwilliam’s original study [9]. However, the Japanese study did not compare the accuracy of PiPS to the accuracy of CES. Differences in cancer epidemiology and oncology practice between Japan and UK may also be a relevant consideration. The study by Kim and co-workers (2014) [12] reported that the PiPS instruments performed approximately as well as in the original study. However, the Kim study included a relatively small number of participants and the study population was restricted to palliative cancer patients in a specialist cancer hospital in South Korea. No large scale validation has yet been undertaken in the UK.

Taken together, these two studies strengthen the case for undertaking a large-scale validation study in the UK using CES as a comparator. Based on systematic reviews [13, 14], four other prognostic models have been identified that might also be useful in clinical practice and which are in need of further evaluation. These are the Palliative Prognostic Index (PPI) [15], the Palliative Performance Scale (PPS) [16], the Palliative Prognostic (PaP) [17] score and the Feliu Prognostic Nomogram (FPN) [18].

The PPI and the PPS can both be calculated without the need for a blood test (like PiPS-A). The PPI model stratifies patients into three groups; survival shorter than 3 weeks; shorter than 6 weeks; or more than 6 weeks [15]. The PPI has shown a high accuracy level in patients with short estimates of survival [19]. The PPS is a measure of functional status and is one of the variables included in the PPI score. Although not specifically designed as a prognostic instrument, and therefore lacking some face validity as a stand-alone prognostic tool, the PPS has been found to have prognostic significance in patients with advanced disease [20, 21]. Using data from large observational studies, the PPS can be used to predict the probability of dying across a range of survival times [20].

The PaP and the FPN, both require blood test results (like PiPS-B). The PaP score classifies patients into three risk groups based on a 30-day survival probability of less than 30%; between 30 and 70%; and more than 70% [17]. There is increasing evidence to support its validity in a variety of settings [22,23,24,25,26]. The total PaP score was shown in one study to be more accurate than a simple clinician prediction of survival [27]. One practical concern with the PaP score is that it relies on CES. This can make the PaP challenging to use when clinicians are unsure about survival times or when an “objective” estimate is required that is free from the influence of CES. The FPN predicts survival at 15, 30 and 60 days [18]. In one study the FPN was found to be more accurate than the PaP [18] and does not rely on subjective CES.

The PiPS2 study was designed with the overall aim of validating the accuracy of the PiPS-A and PiPS-B [9]. The primary objectives of the study are: to validate the PiPS models and; to compare the performance of PiPS-B against CES. The secondary objectives are to validate other selected prognostic models (PPI, PPS, PaP and FPN).

A nested qualitative sub-study has also been embedded in the PiPS2 study to assess the acceptability of the prognostic models to patients, carers and clinicians and to identify barriers and facilitators to clinical use. This is particularly relevant because in clinical practice it is often the relatives and carers of non-competent or semi-conscious patients who most wish to have access to accurate prognostic information.

Methods

Study design

This is a multi-centre, prospective, observational, cohort study to validate various prognostic models in patients with advanced, incurable cancer. The study involves patients from 28 palliative care services across England and UK and is sponsored by University College London.

Patients were recruited in three palliative care settings:

  1. a)

    community palliative care teams (including day hospice and palliative care outpatients)

  2. b)

    hospital palliative care teams

  3. c)

    inpatient palliative care units

The planned recruitment period for the validation study was from August 2016 to the end in April 2018. At least three months after all recruitment has ended, a list of study participants will be sent to the Health and Social Care Information Centre (HSCIC) in order to determine dates of death. The accuracy of the studied prognostic models will then be compared against actual survival.

Following Medical Research Council Guidance [28] a subset of patients who agreed to participate in the main study, their next-of-kin (informal carers), patients who declined to participate in the main study, and health care professionals, were recruited into a nested qualitative sub-study to explore views about prognostication and the use of prognostic tools.

Participants

The study involved both patients with or without capacity to consent to participate. Many patients at the end of their lives become confused, semi-conscious, and comatose or may have pre-existing cognitive impairment, they therefore frequently lack capacity to consent to participate in research. The inclusion of patients who lack capacity is therefore of great importance as the study population should be representative of those patients commonly seen in palliative care services. Capacity was assessed by the attending clinician using the Department of Health guidance [29]. If capacity was in doubt, the clinician carried out a capacity test as provided by the Royal College of General Practitioners’ Mental Capacity Act Toolkit for Adults in England and Wales 2011 [30].

Inclusion criteria

  1. a)

    Patients with locally advanced or metastatic incurable cancer. A patient with incurable cancer has an estimated prognosis of survival of less than one year.

  2. b)

    Men and women aged 18 years or over.

  3. c)

    Patients who had recently been referred to palliative care services. Recent referral has various meanings across different palliative care settings. For a community, day hospice or palliative care outpatient, “recent” means that the patient should have had fewer than three previous contacts with the palliative care service before they are recruited to the study. For inpatient palliative care patients (including hospital support teams), “recent” referral means that the patient should have been first seen by a member of the palliative care team no more than 7-days previously. The date of referral was considered the date the patient had first been seen by a member of the relevant palliative care team.

  4. d)

    Sufficient English language skills for patients with capacity to read and understand the Patient Information Sheet and undertake study assessments.

Exclusion criterion

Patients receiving (or planned to receive) treatment with curative intent at the time of consent. Patients receiving palliative treatment were still eligible to participate.

Study assessments

Data were collected at a single time point and were usually obtained from a review of the medical notes or from a discussion with clinical staff. If patients were able to respond to questions data might have partly been obtained directly from them. The data that were required for the calculation of each prognostic score are shown in Table 1.

Table 1 Data required for the calculation of prognostic models

Demographic, disease and treatment related data and capacity recording

Demographic details of enrolled patients, such as age, gender and current patients’ location (e.g., home, hospital, hospice) were recorded. National Health Service (NHS) number and date of birth were also recorded to be sent to the HSCIC. Information on the nature and site of primary tumour and sites of metastases (if any) were also collected. Additionally, patients’ capacity to consent to participate in the study was documented.

Key symptoms

The presence or the absence of key symptoms was recorded (this was required for the scoring of the prognostic models); anorexia, dysphagia, dyspnoea, fatigue and weight loss.

Abbreviated mental health score

This is a test that assesses cognitive function [31]. This test is not applicable to patients without capacity, who were attributed scores of zero.

Clinical assessments

Clinical assessments included:

  1. 1.

    Recording of the presence or the absence of ascites, peripheral oedema, delirium and decreased oral intake. Pulse rate was also measured over one minute.

  2. 2.

    The Eastern Co-operative Oncology Group (ECOG) performance status [32]. This is a measurement of patients’ level of everyday functioning.

  3. 3.

    A 7-point scale of observer-rated health status. The scores range from very poor (point 1) to excellent (point 7).

  4. 4.

    The Karnofsky Performance Scale (KPS) [33] this is used to assess patients’ functional impairment.

  5. 5.

    The PPS [16]. This is one of the prognostic models that this study aims to validate. It describes the patients’ current ambulatory level; activity level and extent of disease; self-care abilities; intake and conscious level.

  6. 6.

    Estimation of the time to terminal disease by the clinicians. This is defined as the time elapsed between the diagnosis and development of incurable disease and is required to calculate the FPN.

Blood test results

For patients with capacity a fresh blood specimen must have been taken. For patients without capacity there was no requirement to take a fresh blood specimen, however if a blood sample was being taken for another reason as a part of routine clinical care within 72 h of study enrolment then the relevant tests were requested. Even if no new specimen was being taken from a patient without capacity, if relevant results were available within 72 h of being enrolled in the study then these results were recorded.

The blood test results required are: white blood count, lymphocyte count, neutrophil count, platelet count, urea, albumin, alkaline phosphatase, alanine transaminase, C-reactive protein, lactate dehydrogenase. Blood specimens were processed locally in the routine clinical laboratory using usual arrangements.

Clinicians’ estimates of survival

The attending doctor and nurse estimated survival of study participants independently. When the estimates agreed then this represented the combined multi-professional prediction. When they were discordant, the doctor and nurse discussed the case and reached a consensus. In order to characterise the prognosticators in more detail they were asked to provide information about themselves (i.e., age, gender, professional training and years of specialist experience). Clinicians were also asked to provide their prognostic estimates using a number of different formats in order to facilitate comparison with the outputs of the prognostic scores. Clinicians were asked: to provide approximate estimates of length of survival - “days” (0–13 days); “weeks” (2–7 weeks); “months+” (2 months or longer); to provide more specific estimates of survival to the nearest week (from < 1 week to > 12 weeks); to estimate the probability of survival at specific time points (1 day; 3 days; 7 days; 15 days; 30 days and 60 days).

Data management

A study database for the storage, management and analyses of identifiable data has been developed via a secure web application named “REDCap” (Research Electronic Data Capture) and using the UCL Data Safe Haven secure system. This system has been certified to the ISO27001 information security standard and conforms to the NHS Information Governance Toolkit (http://www.ucl.ac.uk/isd/itforslms/services/handling-sens-data/tech-soln).

The rest of the (non-identifiable) study data have been sent to a separate database (i.e., electronic Case Report Form - eCRF) that has been created and supported by a company called “Sealed Envelope” (https://www.sealedenvelope.com/). Data from the paper CRFs have manually been transferred to the eCRFs by the researchers at each participating site.

A data monitoring plan has also been put in place to ensure optimal data quality across sites.

Recruitment procedure

Patients’ identification

In each participating service, members of the clinical team maintained a screening log of all new referrals to the service. For the patients who were not eligible to participate, the screening log records the following information: age range, gender, reason for ineligibility.

Consent procedure

Study procedures differed between patients with and without capacity.

Patients with capacity

Eligible patients were approached by a member of the clinical team about participation in the study. If eligible patients were not approached by a team member then the reason for failure to do so was recorded on the screening log.

Potential participants who had been approached by a member of the clinical team were asked if they are be willing to speak to a member of the research team and are handed a Patient Information Sheet (PIS). A member of the research team then discussed the study with the patient and sought their consent to participate. For community patients this discussion might have occurred over the telephone. Written informed consent was usually obtained at least 24 h after the PIS had been handed out but could have been obtained on the same day if it was more convenient and acceptable for the patient to do so. If the patient declined to participate in the study then the reason for this (if known) was documented on the screening log.

Patients without capacity

For patients without capacity a personal consultee was sought for advice. For patients with no personal consultee, the advice of a nominated consultee was sought. The nominated consultee was usually another doctor working in the hospital/hospice (who was not involved in the research), a social worker, a chaplain or the patient’s General Practitioner (GP).

In a similar manner to the approach adopted for patients with capacity, consultees of patients without capacity were advised that it was usual practice to wait for 24 h before giving assent. If the consultee gave telephone advice for the patient to be included in the study but they are unable to visit the unit to provide written evidence of assent then verbal agreement was initially deemed to be sufficient to allow the research team to enrol the patient in the study and start data collection. However, in these circumstances an assent form was posted to the consultee to be signed and returned to the research team within two weeks of the patient being enrolled in the study. If no signed assent form was received then the patient was withdrawn from the study and all data were destroyed.

Patients with fluctuating capacity

Patients who temporarily lacked and then recovered capacity were informed about their involvement in the study and have the opportunity to withdraw or confirm participation [9].

Outcome measures

Primary outcome measures

The survival of patients (measured from the date patients consented to participate), the CES and the predictions of the PiPS-A and the PiPS-B prognostic models.

Secondary outcome measures

The predictions produced by the PPI, PPS, PaP and FPN.

Sample size

The sample size calculations are based on data collected during the original study [9].

For the comparison between PiPS-B model predictions and CES

PiPS-B is the primary model of interest for this research. To show at least a 5% improvement in correct predictions using PiPS-B compared to clinicians’ predictions, assuming 80% power and 5% significance level and using a McNemar’s test, a total of 1267 patients will be required. The formula and the software used for these calculations are based on the work produced by Machin and co-workers (2009) [34]. It is estimated that in order to obtain 1267 complete data sets it is be necessary to recruit 1334 patients with capacity (assuming 5% missing data). In order to recruit 1334 patients with capacity it is be necessary to recruit 1778 patients in total (assuming 25% of patients will lack capacity).

For the validation of the PiPS models

To validate predictions from a risk model it has been recommended that the validation data should have at least 100 events [35]. The validation data for the proposed study will involve several centres. There is no guidance on sample size calculation for multi-centre validation data. We expect clustering of patients within centres to be minimal based on other studies in community care [36]. However, to be conservative we have inflated the number of events required in the validation data to 150. Assuming an event rate of 17.8%, based on the original study, we will require 843 patients to validate the PiPS-B model. In fact, 1778 patients will be recruited, most of who will be able to provide data for the validation of both PiPS-A and PiPS-B, thus this sample size will be more than adequate to validate both models. Using similar arguments, the proposed sample size will also be more than sufficient to simply validate the other prognostic models (i.e., PPI, PPS, PaP and FPN).

Planned analyses

Descriptive analysis

Predictors and outcomes will be summarised using descriptive analysis. Categorical predictors will be reported as raw numbers and percentages. Continuous variables will be summarised using mean or median and standard deviation or interquartile (IQ) range as appropriate. The percentage of values missing for each predictor will also be presented. The survival times of patients will be summarised using median and IQ ranges, and Kaplan Meier graphs.

Primary analyses

Validation of PiPS models (comparison between PiPS model predictions and actual patients’ survival)

The PiPS models will be validated as they were presented for use in the original study by Gwilliam and co-workers [9]. For both PiPS-A and PiPS-B, two separate models have been developed to predict the two week (14 day) and two month (56 day) survival of patients, thus, generating three prognostic categories i.e., less than two weeks, two weeks to two months and greater than two months.

The discriminatory ability of the models will be assessed using the C-statistic. Separate C-statistics will be calculated for the “two weeks” and the “two months” models. The PiPS online calculator provides (see www.pips.sgul.ac.uk) a prediction as to whether a patient will survive for “days”, “weeks” or “months”. Model performance will also be assessed by plotting Kaplan-Meier survival curves for each of the three risk groups identified by the PiPs models (“days,” “weeks,” and “months+”). The model calibration will be assessed by comparing observed and predicted probabilities [37].

Comparison between PiPS-B model predictions and CES

To compare the accuracy of the model predictions and CES, the primary analysis will focus on the PiPS-B model. McNemar’s test will be used to compare the proportion of overall patient deaths predicted correctly by PIPS-B with the corresponding proportion predicted correctly by clinicians.

Secondary analyses

As part of the secondary analyses the PiPS models’ predictions for the two week and two month cut-off points will be combined to produce a categorical prediction of survival (“days,” “weeks,” or “months/years”) and will be compared with clinicians’ estimates and the corresponding observed values descriptively with respect to their accuracy. Linear weighted k will also be used to compare the performance of the clinicians with that of the models.

The PPI, PPS, PaP and FPN prognostic models will also be assessed as a part of the secondary analyses. The calibration of these prognostic models will be assessed using the calibration slope [37] based on a logistic model for binary outcomes and Cox model for survival outcomes [38]. Graphical comparisons of the observed and predicted risks for clinically relevant patient risk groups will also be made. Clinically relevant time points will be used for comparisons for survival outcomes. Model discrimination will be assessed using the C-statistic for binary outcomes and C-index for survival outcomes [39]. The performance measures estimated for the various models will be compared descriptively. The predictions made by these prognostic models will also be compared with the corresponding observed outcomes and clinician predictions (where available).

Bias due to missing data will be investigated and multiple imputation based on chained equations [40] will be used to impute missing predictor values if considered necessary.

Interim results – Patient recruitment

Recruitment started in August 2016 and the required sample size was reached by the end April 2018 (see Fig. 1).

Fig. 1
figure 1

PiPS2 recruitment chart

Nested qualitative sub-study

Semi-structured, face to face interviews were conducted with a purposive sample of approximately 15 patients, 15 carers and 15 clinicians to determine the acceptability of using prognostic indicators, and barriers and facilitators to clinicians’ use. Data saturation will determine the final sample sizes, which may be larger or smaller than anticipated. To date, 28 patients, 19 carers and 32 clinicians were enrolled in the qualitative sub-study.

Interviews were audio recorded, and used iterative topic guides based on reviews of the literature, themes arising from preceding interviews, and the MORECare recommendations for conducting research at the end of life [41] The patient and carer interviews explored whether participants wish to know the patient’s prognosis, and if so whether they would have preferred clinicians’ estimates of survival or prognostic modelling. Those wishing to know their prognosis were asked how this information should have been presented to them. Interviews were of 30–60 min duration to ensure that participants were not overburdened.

The clinician interviews were interactive and explored the acceptability of PiPS, PPI, PPS, PAP and FPN. Participants were shown the prognostic models, and commented on their utility. Topic guides included questions about potential barriers and facilitators to using the models, and to discussing prognostic information with patients and carers. Interviews were of 60 min duration to allow enough time for in-depth discussion.

Interview data will be entered into NVivo 10.0 (https://www.qsrinternational.com/nvivo/) and analysed using the five stages of Framework Analysis [42]: familiarisation, developing a thematic framework, indexing, charting, and mapping and interpretation.

Discussion

This study recruited the required sample size of 1778 patients across England and Wales by the end of April 2018. These data demonstrate that recruitment to a multi-centre prospective palliative care study is achievable. The results of this study, should permit a recommendation to be made about the accuracy of a variety of prognostic models, and whether or not the PiPS-B model is significantly better than a multi-professional MDT estimate of survival. In addition to this quantitative validation study, an embedded qualitative sub-study is also being undertaken. This is designed to assess the acceptability of the different prognostic models to patients, carers and clinicians and to make an assessment of the barriers to clinical use. We anticipate that the overall results of our research are expected to remain relevant and important to the needs of the NHS in the future as the number of patients with advanced cancer is anticipated to increase substantially over the next twenty years.

Change history

  • 03 November 2018

    After publication, the authors noticed some minor errors in “Nested qualitative sub-study” section, first paragraph of the section, page 7 of the published article.

Abbreviations

(e)CRF:

(electronic) Case Report Form

CES:

Clinicians’ Estimates of Survival

ECOG:

Eastern Co-operative Oncology Group

FPN:

Feliu Prognostic Nomogram

GP:

General Practitioner

HSCIC:

Health and Social Care Information Centre

IQ:

Interquartile

KPS:

Karnofsky Performance Scale

NHS:

National Health Service

PaP:

Palliative Prognostic score

PiPS:

Prognosis in Palliative care Scales

PIS:

Patient Information Sheet

PPI:

Palliative Prognostic Index

PPS:

Palliative Performance Scale

References

  1. Adams E, Boulton M, Watson E. The information needs of partners and family members of cancer patients: a systematic literature review. Patient Educ Couns. 2009;77(2):179–86.

    Article  Google Scholar 

  2. Degner LF, Kristjanson LJ, Bowman D, Sloan JA, Carriere KC, O'Neil J, Bilodeau B, Watson P, Mueller B. Information needs and decisional preferences in women with breast cancer. JAMA. 1997;277(18):1485–92.

    Article  CAS  Google Scholar 

  3. Steinhauser KE, Christakis NA, Clipp EC, McNeilly M, Grambow S, Parker J, Tulsky JA. Preparing for the end of life: preferences of patients, families, physicians, and other care providers. J Pain Symptom Manag. 2001;22(3):727–37.

    Article  CAS  Google Scholar 

  4. Kirk P, Kirk I, Kristjanson LJ. What do patients receiving palliative care for cancer and their families want to be told? A Canadian and Australian qualitative study. BMJ. 2004;328(7452):1343.

    Article  Google Scholar 

  5. Kutner JS, Steiner JF, Corbett KK, Jahnigen DW, Barton PL. Information needs in terminal illness. Soc Sci Med. 1999;48(10):1341–52.

    Article  CAS  Google Scholar 

  6. Glare P, Virik K, Jones M, Hudson M, Eychmuller S, Simes J, Christakis N. A systematic review of physicians’ survival predictions in terminally ill cancer patients. BMJ. 2003;327(7408):195–8.

    Article  Google Scholar 

  7. Neuberger J, Guthrie C, Aaronovitch D, Hameed K, Bonser T, Pentregath Ho, Charlesworth-Smith D, Jackson E, Cox D, Waller S: More care, less pathway - a review of the Liverpool care pathway 2013.

    Google Scholar 

  8. News analysis: What is the Liverpool Care Pathway? [https://www.nhs.uk/news/medical-practice/news-analysis-what-is-the-liverpool-care-pathway/]. Accessed 15 May 2018.

  9. Gwilliam B, Keeley V, Todd C, Gittins M, Roberts C, Kelly L, Barclay S, Stone PC. Development of prognosis in palliative care study (PiPS) predictor models to improve prognostication in advanced cancer: prospective cohort study. BMJ. 2011;343:d4920.

    Article  Google Scholar 

  10. Gold Standards Framework Prognostic Indicator Guidance (PIG) [https://www.goldstandardsframework.org.uk/cd-content/uploads/files/General%20Files/Prognostic%20Indicator%20Guidance%20October%202011.pdf]. Accessed 15 May 2018.

  11. Baba M, Maeda I, Morita T, Hisanaga T, Ishihara T, Iwashita T, Kaneishi K, Kawagoe S, Kuriyama T, Maeda T, et al. Independent validation of the modified prognosis palliative care study predictor models in three palliative care settings. J Pain Symptom Manag. 2015;49(5):853–60.

    Article  Google Scholar 

  12. Kim ES, Lee JK, Kim MH, Noh HM, Jin YH. Validation of the prognosis in palliative care study predictor models in terminal cancer patients. Korean J Fam Med. 2014;35(6):283–94.

    Article  Google Scholar 

  13. Stone PC, Lund S. Predicting prognosis in patients with advanced cancer. Ann Oncol. 2007;18(6):971–6.

    Article  CAS  Google Scholar 

  14. Lund SS, P. Predicting survival in advanced cancer patients. European Journal of Paliative Care. 2013;20(2):58–61.

    Google Scholar 

  15. Morita T, Tsunoda J, Inoue S, Chihara S. The palliative prognostic index: a scoring system for survival prediction of terminally ill cancer patients. Support Care Cancer. 1999;7(3):128–33.

    Article  CAS  Google Scholar 

  16. Anderson F, Downing GM, Hill J, Casorso L, Lerch N. Palliative performance scale (PPS): a new tool. J Palliat Care. 1996;12(1):5–11.

    CAS  PubMed  Google Scholar 

  17. Pirovano M, Maltoni M, Nanni O, Marinari M, Indelli M, Zaninetta G, Petrella V, Barni S, Zecca E, Scarpi E, et al. A new palliative prognostic score: a first step for the staging of terminally ill cancer patients. Italian multicenter and study group on palliative care. J Pain Symptom Manag. 1999;17(4):231–9.

    Article  CAS  Google Scholar 

  18. Feliu J, Jimenez-Gordo AM, Madero R, Rodriguez-Aizcorbe JR, Espinosa E, Castro J, Acedo JD, Martinez B, Alonso-Babarro A, Molina R, et al. Development and validation of a prognostic nomogram for terminally ill cancer patients. J Natl Cancer Inst. 2011;103(21):1613–20.

    Article  Google Scholar 

  19. Stone CA, Tiernan E, Dooley BA. Prospective validation of the palliative prognostic index in patients with cancer. J Pain Symptom Manag. 2008;35(6):617–22.

    Article  Google Scholar 

  20. Lau F, Downing M, Lesperance M, Karlson N, Kuziemsky C, Yang J. Using the palliative performance scale to provide meaningful survival estimates. J Pain Symptom Manag. 2009;38(1):134–44.

    Article  Google Scholar 

  21. Olajide O, Hanson L, Usher BM, Qaqish BF, Schwartz R, Bernard S. Validation of the palliative performance scale in the acute tertiary care hospital setting. J Palliat Med. 2007;10(1):111–7.

    Article  Google Scholar 

  22. Maltoni M, Nanni O, Pirovano M, Scarpi E, Indelli M, Martini C, Monti M, Arnoldi E, Piva L, Ravaioli A, et al. Successful validation of the palliative prognostic score in terminally ill cancer patients. Italian multicenter study group on palliative care. J Pain Symptom Manag. 1999;17(4):240–7.

    Article  CAS  Google Scholar 

  23. Glare P, Virik K. Independent prospective validation of the PaP score in terminally ill patients referred to a hospital-based palliative medicine consultation service. J Pain Symptom Manag. 2001;22(5):891–8.

    Article  CAS  Google Scholar 

  24. Glare PA, Eychmueller S, McMahon P. Diagnostic accuracy of the palliative prognostic score in hospitalized patients with advanced cancer. J Clin Oncol. 2004;22(23):4823–8.

    Article  Google Scholar 

  25. Naylor C, Cerqueira L, Costa-Paiva LH, Costa JV, Conde DM, Pinto-Neto AM. Survival of women with cancer in palliative care: use of the palliative prognostic score in a population of Brazilian women. J Pain Symptom Manag. 2010;39(1):69–75.

    Article  Google Scholar 

  26. Tarumi Y, Watanabe SM, Lau F, Yang J, Quan H, Sawchuk L, de Moissac D, Wolch G, Thai V. Evaluation of the palliative prognostic score (PaP) and routinely collected clinical data in prognostication of survival for patients referred to a palliative care consultation service in an acute care hospital. J Pain Symptom Manag. 2011;42(3):419–31.

    Article  Google Scholar 

  27. Hui D, Park M, Liu D, Paiva CE, Suh SY, Morita T, Bruera E. Clinician prediction of survival versus the palliative prognostic score: which approach is more accurate? Eur J Cancer. 2016;64:89–95.

    Article  Google Scholar 

  28. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, Medical Research Council G. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.

    Article  Google Scholar 

  29. Nicholson TR, Cutter W, Hotopf M. Assessing mental capacity: the mental capacity act. BMJ. 2008;336(7639):322–5.

    Article  Google Scholar 

  30. The Royal College of General Practitioners’ Mental Capacity Act Toolkit for Adults in England and Wales [http://www.rcgp.org.uk/-/media/Files/CIRC/Learning-disabilities/Learning-disabilities-resources/CIRC_Mental-Capacity-Act-Toolkit-2011.ashx?la=en]. Accessed 15 May 2018.

  31. Hodkinson HM. Evaluation of a mental test score for assessment of mental impairment in the elderly. Age Ageing. 1972;1(4):233–8.

    Article  CAS  Google Scholar 

  32. Oken MM, Creech RH, Tormey DC, Horton J, Davis TE, McFadden ET, Carbone PP. Toxicity and response criteria of the eastern cooperative oncology group. Am J Clin Oncol. 1982;5(6):649–55.

    Article  CAS  Google Scholar 

  33. Karnofsky D, Burchenal J. The Clinical evaluation of Chemotherapeutic Agents in Cancer. In: MacLeod CM, editor. Evaluation of Chemotherapeutic Agents. New York: Columbia University Press; 1949. p. 196.

    Google Scholar 

  34. Machin D, Campbell MJ, Beng Tan S, Huey Tan S. Sample size tables for clinical studies. 3rd ed. Oxfrod: Wiley-Blackwell; 2009.

    Google Scholar 

  35. Harrell F. Regression Modelling Strategies with Applications to Linear Models. In: Logistic Regression and Survival Analysis. 1st ed. New York: Springer; 2002. p. 92.

    Google Scholar 

  36. Adams G, Gulliford MC, Ukoumunne OC, Eldridge S, Chinn S, Campbell MJ. Patterns of intra-cluster correlation from primary care research to inform study design and analysis. J Clin Epidemiol. 2004;57(8):785–94.

    Article  Google Scholar 

  37. Miller ME, Langefeld CD, Tierney WM, Hui SL, McDonald CJ. Validation of probabilistic predictions. Med Decis Mak. 1993;13(1):49–58.

    Article  CAS  Google Scholar 

  38. Steyerberg E. Clinical prediction models. A practical approach to development, validation and updating. Rotterdam: Springer; 2009.

    Google Scholar 

  39. Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, Pencina MJ, Kattan MW. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology. 2010;21(1):128–38.

    Article  Google Scholar 

  40. White IR, Royston P, Wood AM. Multiple imputation using chained equations: issues and guidance for practice. Stat Med. 2011;30(4):377–99.

    Article  Google Scholar 

  41. Higginson IJ, Evans CJ, Grande G, Preston N, Morgan M, McCrone P, Lewis P, Fayers P, Harding R, Hotopf M, et al. Evaluating complex interventions in end of life care: the MORECare statement on good practice generated by a synthesis of transparent expert consultations and systematic reviews. BMC Med. 2013;11:111.

    Article  Google Scholar 

  42. Ritchie J, Lewis J, Elam G. Designing and selecting samples. In: Ritchie J, Lewis J, editors. Qualitative research in practice: A guide for social science students and researchers. London: SAGE; 2003. p. 77–108.

    Google Scholar 

Download references

Acknowledgements

We would like to thank the UCL PRIMENT Clinical Trials Unit for their support, Karolina Christodoulides and Jane Harrington for their help with administrative tasks and data monitoring, and Florence Todd-Fordham for contributing to data quality control procedures. We would like to thank Peter Buckle and Dori-Anne Finlay for acting as Patient and Public Representatives for the study. We would finally like to thank all the patients who participated in this study and our collaborators across participating sites.

Funding

This research is funded by the National Institute of Health Research (NIHR) Health Technology Assessment (HTA) Programme (Ref: 13/20/01). This was a commissioned call for research by the funding body, which did not play a role in the study design, data collection, or data analysis.

Availability of data and materials

Data sharing is not applicable as no datasets have been analysed as yet. Materials that were developed to support the current study are available from the corresponding author.

Author information

Authors and Affiliations

Authors

Contributions

AKK was responsible for drafting the manuscript, coordinating data collection and the overall running of the research across participating sites. CT, VK, JG and RZO contributed to the conception and design of the study. RZO and VV were responsible for the production of the statistical analysis plan of the study. KS was responsible for data collection for the nested qualitative sub-study. PS led the conception and design of the study, applied for funding and drafted the study protocol. All authors read, critically revised and approved the final manuscript.

Corresponding author

Correspondence to Patrick Stone.

Ethics declarations

Ethics approval and consent to participate

The study received ethical approval from the Yorkshire & the Humber - Leeds East Research Ethics Committee on 12th April 2016 (reference number: 16/YH/0132). All patients with capacity provided written informed consent. For patients without capacity, a personal consultee, who was designated as next of kin, provided assent by signing a declaration form. For patients with no next of kin, a nominated consultee signed the declaration form, if they thought it appropriate. Members of staff of the palliative care setting, who had no connection to the PiPS2 research project, acted as nominated consultees (for further details please “Methods” section).

Consent for publication

Not applicable; the manuscript does not contain data from any individual person.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kalpakidou, A.K., Todd, C., Keeley, V. et al. The Prognosis in Palliative care Study II (PiPS2): study protocol for a multi-centre, prospective, observational, cohort study. BMC Palliat Care 17, 101 (2018). https://doi.org/10.1186/s12904-018-0352-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12904-018-0352-y

Keywords