Skip to main content

Randomised controlled trial of a new palliative care service: Compliance, recruitment and completeness of follow-up

Abstract

Background

Palliative care has been proposed for progressive non-cancer conditions but there have been few evaluations of service developments. We analysed recruitment, compliance and follow-up data of a fast track (or wait list control) randomised controlled trial of a new palliative care service – a design not previously used to assess palliative care.

Methods/Design

An innovative palliative care service (comprising a consultant in palliative medicine, a clinical nurse specialist, an administrator and a psychosocial worker) was delivered to people severely affected by multiple sclerosis (MS), and their carers, in southeast London. Our design followed the MRC Framework for the Evaluation of Complex Interventions. In phase II we conducted randomised controlled trial, of immediate referral to the service (fast-track) versus a 12-week wait (standard best practice). Main outcome measures were: compliance (the extent the trial protocol was adhered to), recruitment (target 50 patients), attrition and missing data rates; trial outcomes were Palliative Care Outcome Scale and MS Impact Scale.

Results

69 patients were referred, 52 entered the trial (26 randomised to each arm), 5 refused consent and 12 were excluded from the trial for other reasons, usually illness or urgent needs, achieving our target numbers. 25/26 fast track and 21/26 standard best practice patients completed the trial, resulting in 217/225 (96%) of possible interviews completed, 87% of which took place in the patient's home. Main reasons for failure to interview and/or attrition were death or illness. There were three deaths in the standard best practice group and one in the fast-track group during the trial. At baseline there were no differences between groups. Missing data for individual questionnaire items were small (median 0, mean 1–5 items out of 56+ items per interview), not associated with any patient or carer characteristics or with individual questionnaires, but were associated with interviewer.

Conclusion

This is the first time a fast track (or wait list) randomised trial has been reported in palliative care. We found it achieved good recruitment and is a feasible method to evaluate palliative care services when patients are expected to live longer than 3–6 months. Home interviews are needed for a trial of this kind; interviewers need careful recruitment, training and supervision; and there should be careful separation from the clinical service of the control patients to prevent accidental contamination.

Trial Registration

Clinical Trials.Gov NCT00364963

Peer Review reports

Background

Trials of new palliative care services are rare and beset with serious methodological problems, in some instances so severe that the studies fail [1]. Systematic reviews have attempted to assess the effectiveness of palliative home care [2], multidisciplinary teams [3, 4], day care [5], support for carers [6], services for older people [7] and in dementia [8]. They identified: (1) a wealth of studies concerned with need rather than treatment, and (2) problems of trial compliance, recruitment, attrition, contamination, bias, outcome measurement and definition of the intervention.

This has led some to question whether randomised controlled trials are appropriate in palliative care [1, 8]. In addition, ethical concerns have been raised about randomising patients who may be near the end of life [9]. However, non-randomised and quasi-experimental studies suffered from similar problems to those found in trials [4–6]. Robust evaluation and trial methods are urgently needed. Modelled on clinical trials, with phase I, II and III studies, the MRC framework for the evaluation of complex interventions has recently provided a useful model for developing and evaluating services or other complex treatments [10, 11]. The recommendation for palliative care to expand to encompass non-cancer patients and cancer patients earlier in their illness urgently needs evaluation. New methods are required to test services in this context.

Multiple sclerosis (MS) is one condition where palliative care is felt to be needed. This chronic disease of the central nervous system affects over 2.5 million people worldwide and is the most common cause of neurological disability in adults under 60 years [12]. As the disease affects many parts of the central nervous system it may be accompanied by marked physical and psychosocial symptoms. In a small proportion of patients the disease may result in profound disability leading to a need for the provision of complex care and, for some people, information on planning around end of life care. Although for many the prognosis is good, around 15% of those affected have primary progressive disease from the outset and a further 35% develop a progressive course after many years of relapsing illness. Thus palliative care may have a role for patients with complex problems, particularly for those with progressive disease.

We designed and sought to determine whether a new palliative care service for people severely affected by MS improves their outcomes. However, because poor recruitment, attrition and missing data are commonly high in palliative care studies [2–4] we wished to test a design not previously used in palliative care – a fast track (also called wait list) trial. This analysis aimed to assess the results of recruitment, compliance, and follow-up of this trial design in this complex group of patients. The design sought to minimise missing data for any reason; and when it was present to understand its patterns and influencing factors. Therefore, we tested the following null hypotheses: 1) missing data would not be associated with patient disability; 2) missing data would not be associated with particular measurement instruments. We explored whether missing data was associated with any other patient, outcome or study characteristics, to inform future imputations. We believe that lessons from our recruitment and trial compliance will add to knowledge in the field and further the development and application of appropriate research in palliative care.

Methods

Design, Project Advisory Committee, Ethical (IRB) approval

We followed the Medical Research Council (MRC) Framework for the Evaluation of Complex Interventions [10, 11]. This follows a similar framework to that of clinical trials and comprises 5 phases: pre-clinical (theory) and phases I (service modelling), II (preliminary evaluation of service), III (full randomised controlled trial), IV (wide adoption and effectiveness studies). We have previously reported the pre-clinical and phase I findings, which comprised qualitative studies [13–15] and systematic literature reviews [16]. Here we report phase II – an open randomised controlled trial to test subsequent evaluation methods and a preliminary comparison of the new service with standard best practice. Figure 1 uses a graphical method [17] to depict the interventions, interviews and timings in the trial.

Figure 1
figure 1

Graphical depiction of intervention in fast track versus standard care trial of a palliative care service.

Although not all phase II MRC Framework studies comprise a randomised trial, we wished to do so because: (1) to begin to operate the service without a trial would make it very difficult to introduce a trial subsequently, and might lead to ethical concerns among staff because of an 'apparent' reduction in service, making a phase III trial impossible, and (2) we felt it important to test the subsequent trial methods. However, we chose to conduct a fast-track versus standard care intervention trial (also called a wait list trial) because we were concerned about contamination and poor uptake in the control group – a problem found in many other randomised controlled trials of palliative care services [3, 4]. In the fast track (wait list) design all patients have the possibility to receive the service, some immediately, and others after a wait (equivalent to a normal wait for NHS services). The detailed protocol is presented elsewhere [13] (registered at clinicaltrials.gov, NCT00364936). A multidisciplinary Project Advisory Committee (PAC) was established for the duration of the project. Research ethics committee approval from King's College Hospital local research ethics committee was granted for all phases of the project.

Patients and carers

Inclusion criteria were: Patients in South East London who were living with MS and were deemed (by staff – MS nurses, neurologists, rehabilitation staff, primary care staff, social workers – and in a few instances via voluntary groups and self referrals) – to have specialist palliative care needs. These referral guidelines were circulated in advance and explained in an accompanying education programme and were defined as problems or unresolved issues with: symptom control, psychosocial needs, end of life, advanced planning (directive and competency or consent), planning needs for or difficulty with nutrition and/or hydration or a complex combination of problems. A consultant in palliative medicine (PE or IJH) not involved in delivering the service screened all referrals. Patients were excluded if the referring staff and the screening deemed they had very urgent needs or were deteriorating rapidly. In this instance immediate referral to the service was offered, and the patient was withdrawn from the trial (required for 5/69 patients). Clinical information was recorded where possible on those excluded from the evaluation to allow further understanding of clinical issues [13].

Randomisation

Consenting patients were randomised after the baseline interview to two arms. One arm received input from the palliative care team immediately (fast track) in addition to standard best practice services. The other arm was offered the palliative care team only after a > 3 month wait, and until then received only best practice (standard best practice) (Figure 1). Statistical colleagues, independent of the research and clinical team, registered the patients, conducted the randomisation and informed the research team, who then informed the patients, and if patients were "fast track" passed their details to the clinical team. The randomisation used the minimisation method [18] to give an equal balance between groups of the following: gender, age, date of diagnosis, and whether patients could or could not communicate.

Standard best practice

Local services, which were available to all those who received the new palliative care service immediately and after a delay, included: MS nurse specialists, district nurses, social services, general practitioners and hospital neurology services. A few patients received home physiotherapy, occupational therapy and/or attended specialist rehabilitation services or clinics and/or other specialist involvement, including continence advice, psychiatry and/or psychology. After 12 weeks of care, patients randomised to this group were offered referral to the palliative care team, as for the fast track group, as if they had been on a waiting list. We chose 12 weeks because the average waiting time for a neurology outpatient appointment at the time was 12–16 weeks, and because we felt that the team was likely to demonstrate an effect in this time. Our pre-clinical and phase I research and advice from the treating neurologist had suggested that most (if not all) patients would still be alive at 12 weeks, making such a wait a realistic option for them.

Fast-track (palliative care team)

This comprised a part-time palliative medicine consultant (who had received training in both palliative medicine and neurology), a palliative care nurse (working 3–4 days per week on average), a psychosocial worker (shared with the hospital palliative care team, who was on maternity leave for 7 months during the project), and a service co-ordinator/administrator. This structure was agreed during our modelling phase based on patient and caregiver needs [13–15]. Following referral a team member would aim to visit a referral to make a comprehensive palliative care assessment within 48 hours (see Figure 1). Following assessment by the team, patients who had not seen a neurologist for some time or requiring review by neurologist were referred to a specialist clinic run by a neurologist with an interest in MS (ES). MS nurses, neurologists, social workers and other staff involved in the care of patients, made referrals. Service met regularly with neurologists and MS nurses to discuss patients of concern. The service aimed to complement and not to replace existing services. Patients were visited in their own homes or in some instances hospital outpatient clinics, nursing homes or hospital. After assessment the team suggested ways to improve management of physical, emotional, social and other problems, provided specialist welfare benefits advice and bereavement support, liaised with and acted as a catalyst with local services, both primary and specialist teams. Follow-up occurred as required, depending on clinical need. The service modelling phase, and a pilot service run by the consultant (RB) suggested that a short term assessment and care was required, with symptom control and other actions occurring during 1–3 visits and then referral on the community palliative care teams if longer follow-up was needed. The team recorded whether they assessed patients to have specialist palliative care needs, as in the referral criteria, and the number of assessments, follow-up and subsequent referrals made.

Research interviews

Face to face interviews were conducted according to a standardised schedule, using trained interviewers, all with previous experience interviewing in palliative care. The interviewers read the questionnaires and outcome measures to the patients, showing them large cards of the possible response categories for standard scales. Interviewers recorded their responses. After the baseline interview, interviews were repeated for both groups at 6 weeks, 12 weeks, and 24–26 weeks (final interview). In addition, at 18 weeks the standard practice group were interviewed (aiming to have an interview 6 weeks after receipt of the palliative care service) (see Figure 1). Because of the high number of interviews needed at certain times of the study, and because of staff changes, 10 different interviewers were used at stages of the project, but one member of staff conducted the majority of interviews. Questionnaires were selected following a systematic literature review and piloting [16], and in addition to the outcome measures (see below) assessed clinical and demographic circumstances and cognitive function (Abbreviated Mental Test Score, AMTS).

Primary outcome measure

For this analysis our main outcomes were trial compliance (the extent the trial protocol was adhered to), recruitment (percentage included in the trial), attrition (percentage lost to follow-up) and missing data. As our main outcome point was at 12 weeks (before cross over) we also report how may interviews were conducted at this point. To assess patient outcomes we used self-reported questionnaires using the Palliative Care Outcome Scale (POS) [19, 20] and a specially adapted symptom version, POS-MS symptoms [21] as measured 12 weeks. The former included 8 items on anxiety, patient and carer concerns, practical needs and the latter 18 questions specifically relating to MS symptoms, both using a 0–4 scale.

Secondary outcome measures

Self-reported quality of life and impact of MS using the Multiple Sclerosis Impact Scale (MSIS) [22, 23] which comprises 29 questions (rated 1–5). We also recorded the patient and caregiver reported use of health and social services (and experience of hospital services) in order to calculate the costs of services, to determine whether the team supplemented or substituted existing services and together with the outcome data to calculate cost effectiveness.

In addition, to determine the patients functional status we used the United Kingdom Neurological Disability Scale – UNDS [24], which comprises 12 sections to assess disability – and using the Expanded Disability Status Scale – EDSS [25] a single item 10 point interviewer assessed scale, a the first and final interviews. We recorded the time taken for the whole interviews.

Carer measures

Carers/families self completed a short separate questionnaire assessing carer burden (using the short form Zarit Carer Burden Inventory, 12 items each rated 0–4) and mastery (using the Lawton caregiver mastery scale, 4 items rated 0–4); either during the patient interview but separately, or returned the questionnaire by post.

Amendments to procedures

Two amendments were made (following further ethical committee approval) early in the study, after reviewing recruitment of the first 5–6 patients.

  1. (1)

    Initially patients refusing to enter the trial were offered the fast track service immediately. This was changed so that patients refusing the study, and without immediate/pressing clinical needs, were offered standard best practice.

  2. (2)

    We lowered our threshold for including patients with cognitive and communication difficulties. We always sought to include all patients where consent and an interview were possible (using technological aids and longer interviews where appropriate). Initially those with cognitive impairment and severe difficulties communicating were excluded because of questions about their ability to provide informed consent. However, as cognitive dysfunction may be a feature of severe MS, we felt that it was important to include this group of patients in the evaluation. After discussion with the PAC it was agreed that patients with severe cognitive impairment were offered inclusion in the trial, provided their carers/families were also in agreement. It was felt that being offered a potentially new service that might help them would be in their best interests and that excluding such patients would mean excluding some individuals which future palliative care services might specifically target.

Analysis

In this analysis we determined the response rate, reasons for acceptance and trial refusal, attrition, follow-up rate and pattern of missing data and we explored whether these were related to any patient or study factors. To test our null hypotheses we tested for correlations between the amount of missing data and levels of patient disability using Spearman's rho, and compared the level of missing data for the different measurement instruments and interviewers using one way ANOVA. In addition, we tested whether there were differences between randomisation groups at baseline.

Sample Size

We had estimated that a sample of 25 patients in each arm would enable us to detect differences of >1.6 on the POS (for individual items) at p < 0.05, power 80%. The main time point for analysis of the main trial was 12 weeks. Large studies have shown that patients with an EDSS of 8 (defined as being unable to walk with limited use of the upper limbs) or more make up about 15% of the MS population [26]. Based on the local patient numbers of people with an EDSS of ≥ 8 we estimated we would identify 3–4 patients per week, and with 60–70% uptake would recruit and follow up 2 of these. Recruitment over 1 year would therefore give us 50–52 patients, to give an indication whether differences between groups were emerging.

Results

Initial recruitment and randomisation

A total of 69 patients were referred to the trial over 11 months. Of these 17 were excluded from the trial. Reasons for trial exclusion were: deemed to have urgent need (symptoms and/or deterioration) and so received fast track service immediately (5); refused consent for the trial (5); had communication difficulties too severe to include (3, note 2 of these occurred in the early stages before we broadened the inclusion criteria); lived outside the visiting area (for service and interviewers) (1); did not have MS (1); language or cognitive problems (1) and administrative error (1) when the family member contacted the team directly, and was mistakenly not offered the trial but instead received the service immediately.

Of the 5 who refused consent, in one instance this was by the family and four instances by the patient. Two refusals (one patient and one family member) were in the early stages of recruitment before the protocol was amended; therefore these two patients were offered and accepted the fast-track service. One family member stated that they did not want their relative to 'risk waiting three months' because they 'have had to wait for lots of things'. After the protocol was amended the refusal rate declined. The other three refusals declined both the study and the service.

The remaining 52 patients were randomised to receive fast track palliative care (26) or standard best practice (26). Thus our planned sample size was achieved in one year of recruitment. Table 1 shows the characteristics of all patients, those randomised to each arm and excluded from the study. The characteristics of all groups were similar: over 90% were white, the age ranged 33–75 and two thirds were women. The majority (96%) had either secondary progressive MS or primary progressive MS. Other disease types included relapsing remitting MS and similar inflammatory CNS diseases such as (Neuromyelitis optica). The mean disease duration was 18 years (SD 9.6 years) before referral to our study; range 0 (a recent diagnosis) to 55 years. On average patients had a high degree of disability, with a mean EDSS score 7.8 (Table 1). Eleven out of 51 patients had scores of 9 or more meaning that they were confined to bed. The EDSS and other measures between the two groups were similar at baseline.

Table 1 Characteristics of patients in the two randomised arms and excluded from the study at baseline (n = 69)

Trial follow-up and attrition

A total of 25/26 fast-track and 21/26 standard best practice patients completed the trial, see Figure 2. One patient initially entered the trial but was excluded because of protocol violation. This patient consented and was randomised to the standard intervention, but due to an administrative error was seen by the service after only a baseline interview, rather than at 12 weeks. Because of limited resources and the preliminary nature of the investigation the principal investigators (PE and IJH) took the decision to continue offering the service, but stop further research data collection, as any such data would have needed to be analysed separately. The patient was fully informed about the ending of research interviews. To ensure that this error did not occur again, subsequently, when patients were randomised to standard best practice, details were kept with the research team until after the third interview at 12 weeks.

Figure 2
figure 2

CONSORT DIAGRAM showing flow of patients through the study.

Main reasons for loss to follow-up were death or illness. The causes of three deaths in the standard best practice group were: myocardial infarction (2), pneumonia complicated by pyogenic pleural effusion with respiratory failure leading to high dependency admission, complicated by iatrogenic injury in a patient receiving chemotherapy (1). The one patient in the fast-track group who died had spent a great deal of time deteriorating in hospital with recurrent infections and pressure sores, and was subsequently discharged home, as her wish was to die at home. One further patient in the fast-track group has subsequently died, after the end of the study.

By 12 weeks, 26/26 patients had questionnaires returned in the fast track group and 22/26 (and 23/26 for one questionnaire) in the standard track group (with some missing data for individual questionnaire items) (Tables 2 and 3). As Table 4 shows the interviews occurred at similar time intervals in fast track and standard groups and at the times intended (Table 4). At 24–26 weeks, in the fast track group out of a total possible 104 patient interviews, 102 (98%) were completed – one interview did not occur because the patient died and one was missed because of an error in interview timing. In the standard track group there were 115/130 (88%) completed interviews; eight were not possible because patients had died, four because of the protocol violation, and three patients were too unwell to participate in one interview. Of those patients who were alive, we completed 217/225 (96%) possible interviews.

Table 2 Amount of missing data for outcome measures in the study, by interview, for patient interviews
Table 3 Main outcome measures of the study and data completion by study arm and interview
Table 4 Planned and actual times to interview in fast track and standard groups

Intervention with team

For the 52 patients included in the trial, team actions were: 25 patients, one to three visits leading to assessment that problems were improved and then the patient was discharged; 21 patients, assessment and communication with patient and caregiver, general practitioner and referrer and advice other appropriate action or referral (e.g. to occupational therapy, social services, neurologist etc, note these patients were all assessed as not having specialist palliative care needs according to the referral criteria and so the team felt their main role was to support and refer to other services); and 6 patients received three assessments and were deemed as needing long term follow up and were referral on to community palliative care services. Of the 17 patients excluded from the trial, 3 refused the trial and the team and so received no team care, 1 patient was assessed but did not have MS, 12 received between one and three visits leading to assessment that problems were improved and then the patient was discharged and one patient was cared for and referred on for long-term community palliative care. All the 13 patients cared for by the team were assessed as having specialist palliative care needs, including the 5 'urgent' patients.

Time taken, location and completeness of data collection at interview

The mean time to complete the baseline (first) interview was 91 minutes (SD = 33); subsequent interviews took on average 61–70 minutes (SD ranged 23–28), and the final interview averaged 82 minutes (SD = 32), overall range 25–150 minutes. In a very few instances the interviewer returned on another day to complete the interview. 87% of interviews occurred in the patient's own home, 6% were in a nursing home and 2% each in hospital, rehabilitation unit, day centre and residential home.

Missing data items were limited. In the baseline interview there was a mean of 5.5, median = 0, items missed per interview (Table 2) out of more than 56 items in the questionnaire. There was one outlier, a patient who had severe cognitive problems, and when this individual's data was excluded the missing data reduced to mean 4.6 items, median 0 items. Over time (except interview 2) the amount of missing questionnaire items reduced to almost none (Table 2). Data for the UNDS and EDSS questionnaire were fully completed, except one interview, apart from the above patient who could not respond to self-report questions. There was some missing data for the MSIS, the POS and the POS-MS. However, this was for particular interviews/patients rather than for specific items. In over 85% of interviews, all items were completed for these questionnaires, and the fast track and standard groups were broadly similar in terms of missing data (Table 3).

Surprisingly there was no consistent relationship between functional disability, measured by EDSS, and missing questionnaire items, supporting our null hypothesis. Significant correlations were not found for interviews at baseline, I3, I4 or I5, and only a weak correlation between higher EDSS score (i.e. greater disability) and missing data for interview 2 (rho= 0.35, p < 0.05). There was, however, a significant relationship between the amount of missing data and the interviewer, see Additional file 1. Interviewer 'B' (who conducted 26 interviews) had on average 10–20 more missing data items per interview than all others. Interviewer 'D' had a slightly higher level of missing data for the baseline interview; all other interviewers had very little missing data. Interviewer A, who had a low rate of missing data, conducted most (137/212, 65%) interviews.

Discussion

We believe that this paper reports the first use in palliative care of both the MRC Framework and a fast-track controlled trial. Overall we found our methods successful with good compliance, endorsing our use of the MRC Framework and this trial design. Further, we achieved our targeted recruitment within the anticipated timescale, had low attrition (only 5/52 patients) and relatively little missing data. This is a considerable achievement in this difficult area but suggests that it can be reproduced. Because of this patient group, several components of our methods were costly; we conducted mainly home interviews and needed to invest time and resources in the phase I study, although this helped model the service [14, 15]. In addition, the existing team caring for patients, including neurologist and MS nurses, were supportive of investigating the potential of palliative care and thus referred appropriate patients in sufficient numbers. This also may have been helped by the phase I study, where other services were involved in modelling the new intervention. This investment paid off, in resulting in a completed, to time, phase II study which achieved its target recruitment.

There are several limitations to this study. We report a phase II study, designed to test the feasibility of the intervention and the evaluation methods. Many phase II studies in the MRC framework are more limited than our trial, often testing the intervention among few patients and not including a randomised component [27]. In contrast, phase II drug therapy trials are often randomised. In our situation, the advantages of a randomised study included decreasing the effects of patient selection bias and the ability to ensure that uniform evaluation criteria were used. Concerned that if the service ran without randomisation, we would never be able to conduct a trial subsequently, and unable to find a suitable non-random comparison group, we appraised the various options for trial. The fast track randomisation appeared to be most feasible. However, at this stage, we were unlikely to have had adequate power for detailed tests comparing the two groups and the broad referral criteria may have resulted in some patients being included who were less likely to benefit from the new service. Despite this, the results we obtained from this study will allow sample size calculation in future studies, and have provided valuable information on the spectrum of needs of people severely affected by MS. As this study is likely to be underpowered, negative or borderline results at this stage should not prevent further development of palliative care for this group of patients.

Different approaches to conducting trials have developed in palliative care. These have included cluster randomisation (where patients in the no service cluster are not aware they are part of a trial) and studies which offered those patients in the control group a 'low level' of service because of fears that patients would not enter the study if they had no service [28]. Many such trials have suffered from selection bias and contamination [29]. In a trial of hospice at home, at the request of the ethics committee patients were randomised 4 (service) to 1 (control), to ensure the service was kept full. In addition, patients referred when the service was 'empty' were offered the service irrespective of their randomisation. This resulted in an underpowered control group that appeared to receive special treatment [30]. All of these studies have proved problematic, with poor recruitment, attrition and bias [9, 29].

A fast-track randomised trial is often called a 'wait list' control or delayed intervention trial. They have successfully been used to evaluate cognitive behavioural therapy [31, 32], preventive strategies [33], complementary therapies [34] and in rehabilitation [35], neurology and mental health [36]. However to us, and our PAC (which was chaired by and included people affected by MS), the term 'wait list' trial seemed inappropriate. In fact, patients were being offered something much more quickly then they would usually receive it, and so the term 'fast track' as compared to "standard care" was adopted. We referred to the 'standard best practice' group as such, because both our PAC and the ethical review committee wished to make it clear to participants that they would receive all services as best practice currently dictated with no unusual delays or waits. Such a 'fast track' trial is often not feasible in palliative care, because few control patients would live long enough to receive the intervention. This is not the case among patients with longer-term conditions, who are now being considered for referral to palliative care, and where much remains to be understood about the effectiveness and cost effectiveness of different models of palliative care. Further, consideration needs to be given to the length of time the 'standard care' group should wait before receiving the intervention. As for cross over trials, if the intervention is expected to produce effects very quickly then the standard care group might receive the intervention after a shorter wait than in our study. Phase I modelling, as in our study, could help to determine this.

We had to make several improvements to our design in the early stages of the study. Patients with urgent needs were not randomised (but data recorded) to provide a whole picture. Patients refusing the trial should be offered the standard track intervention, not the fast-track, otherwise the position of equipoise is not maintained and patients (and/or their carers) are likely to refuse, in the expectation of receiving the service. This is an important principal to make clear to staff, and it was only after we had begun the study that the effects of getting this wrong became clear to us, and we amended the design. We had good compliance and uptake for the trial, achieving our intended numbers and sometimes having more interviews to do than one interviewer could manage, probably because of; a) an uneven distribution of referrals (ranging up to 6 per week, with an increase after training events) and, b) slightly different interview schedules in two groups, with the SI group having one more interview, so some interviews becoming bunched. Although using the relatively large number of interviewers allowed us to examine missing data across interviews, having 10 interviewers in the project may have introduced unreliability, though we attempted to minimise this with training. It may not have been ideal for patients and carers, who may have wished to have the same interviewer throughout the project. In planning projects in the future resources need to be put in place for potentially fluctuating numbers of referrals.

The management of 'urgent' referrals and those with severe cognitive impairment was another challenge. In this instance independent consultants in palliative medicine spoke to the referrers and attempted to screen out cases where need was not acute. However, it may be that those who were deemed as urgent or very impaired by referrers were also the group whom palliative care would benefit most, reducing the chance of finding a difference in our study. The teams assessment and actions seems to support this: the team assessed as having specialist palliative care needs all 13 (excluding refusals or not MS) patients who were referred directly to the service outside of the trial, but only 31/52 of those randomised. Although the clinical team collected outcome data on these urgent and other referrals, so there is an opportunity to describe the group, this data is likely to be incomplete and may be biased. In the future we would advise that these patients are recruited for data collection by interviewers if possible, so that their circumstances can be independently verified. However, this will require additional resources for interviews.

Compared to many studies in palliative care [37, 38] our missing data was slight, and considerably less than the usual levels found in palliative care, where data can be missing in trials and longitudinal studies for up to 50–70% of participants [37–42], often because of death or illness. Cluster randomised trials by Addington-Hall et al and Jordhøy et al were only able to include less than 65% of patients at baseline, with rapid attrition even in the first month [9, 37]. We were helped by the careful piloting of our methods, having a dedicated research team, the initial service modelling phase (all of which increase the study costs), and by the fact that people affected by MS have a much longer illness trajectory than do people with far advanced cancer. However, we believe we were also helped by the 'fast track' design, and the knowledge that all patients would be offered the service, with waits for it no longer than those for an outpatient appointment. In our study, recruitment was as expected and only 4 patients died during the course of the trial. Interestingly, three of these were in the standard intervention group – although the causes of death seemed unrelated to the MS.

Another problem in palliative care can be missing data for individual questionnaire items at interview. In a randomised controlled trial of a home palliative care service, McWhinney failed to collect enough usable data over time [43]. In our trial, of those patients who remained alive, we conducted 96% of all possible interviews, and missed a median of 0 items, mean 5.5 items out of over 60 per questionnaire (92% of data items collected). Thus, we had relatively little missing data and were able to conduct interviews for around 1 hour with this group, despite a high level of functional impairment. The amount of missing data at interview was not correlated with the level of functional impairment, or the questionnaires used (supporting, to our surprise, our null hypothesis). However, missing data was related to the interviewer. Many of our people with MS were very disabled, making interviews sometimes more difficult to conduct and potentially distressing for interviewers. This suggests that continued training, careful supervision and monitoring are needed, with feedback to and support of interviewers at an early stage. It also suggests that although we had little missing data, we might have been able to reduce this even further. It indicates that highly skilled quantitative interviewers are needed in palliative care research, because they have to deal with sensitive issues while collecting data within standard questionnaires, often not an easy task. There is often an emphasis on the experience and interviewing skills of qualitative researchers, but some funding agencies suggest that quantitative interviews need not be so experienced. However, our study suggests that skilled and well-trained quantitative interviewers are also important for the quality of research data. This has important implications in some countries: for example in the UK there is a belief that central National Cancer Research Institute nurses, who are involved in a range of cancer studies, could be an interviewing resource for palliative care studies. Our study suggests that careful training and assessment would be needed to establish if this were the case.

Conclusion and Recommendations

Our experience suggests that the use of fast track randomised controlled trial (sometimes called a wait list trial) used within the context of the MRC Framework, is feasible and successful in palliative care, when patients have a longer prognosis and are likely to be alive to receive the service after the 'wait' period. We propose that this trial methodology could be used to evaluate new palliative services in cancer or non-cancer patients who have similar illness trajectories. This might apply to other neurological conditions, e.g. Parkinson's disease, and some organ failures, e.g. COPD, and supportive, primary or earlier stage palliative cancer care. Good collaboration with referring services, in identifying appropriate patients is essential. For those with urgent needs data should be obtained and analysed separately. Our method and experience provides a template for future studies in palliative and supportive care. We also found that missing data is mainly interviewer dependent, requiring careful supervision systems. The standard questionnaires used in this study – MSIS, POS, UNDS – appear to work functionally well and have little missing data in this population. Figure 3 shows our main recommendations for those developing and evaluating new palliative care services (especially for patients expected to have longer trajectories). If followed these should significantly improve the quality of palliative care trials, and take advantage of the major opportunity that currently presents itself to conduct trials among non-cancer patients. There is also a need to educate funders of services and research to provide sufficient resources to conduct evaluation of services in this way.

Figure 3
figure 3

Recommendations for those developing new palliative care services, especially for those patients with longer trajectories.

References

  1. McQuay H, Moore A: Need for rigorous assessment of palliative care [editorial; comment]. BMJ. 1994, 309: 1315-1316.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Smeenk FWJM, Van Haastregt JCM, de Witte LP, Crebolder FJM: Effectiveness of home care programmes for patients with incurable cancer on their quality of life and time spent in hospital: a systematic review'. BMJ. 1998, 316: 1939-1943.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Rinck G, van den Bos GAM, Kleijnen JGVM, de Haes HJ, Schade E, Veenhof CH: Methodological Issues in Effectiveness Research on Palliative cancer Care: A systematic review. J Clin Oncol. 1997, 15: 1697-1707.

    CAS  PubMed  Google Scholar 

  4. Higginson IJ, Finlay IG, Goodwin DM, Hood K, Edwards AGK, Cook A, Douglas HR, Normand CE: Is there evidence that palliative care teams alter end-of-life experiences of patients and their caregivers?. Journal of Pain & Symptom Management. 2003, 25: 150-168. 10.1016/S0885-3924(02)00599-7.

    Article  Google Scholar 

  5. Davies E, Higginson IJ: Systematic review of specialist palliative day-care for adults with cancer. Support Care Cancer. 2005, 13: 607-627. 10.1007/s00520-004-0739-6.

    Article  PubMed  Google Scholar 

  6. Harding R, Higginson IJ: What is the best way to help caregivers in cancer and palliative care? A systematic review of interventions and their effectiveness. Palliat Med. 2003, 17: 63-74. 10.1191/0269216303pm667oa.

    Article  CAS  PubMed  Google Scholar 

  7. Davies E: What are the appropriate services and support to address the palliative care needs for older people? Report to the Health Evidence Network. 2004, Copenhagen, WHO Regional Office for Europe. , -[http://www.euro.who.int/document/E83747.pdf]

    Google Scholar 

  8. Sampson EL, Ritchie CW, Lai R, Raven PW, Blanchard MR: A systematic review of the scientific evidence for the efficacy of a palliative care approach in advanced dementia. Int Psychogeriatr. 2005, 17: 31-40. 10.1017/S1041610205001018.

    Article  CAS  PubMed  Google Scholar 

  9. Jordhøy MS, Kaasa S, Fayers P, Øvreness T, Underland G, Ahlner-Elmqvist M: Challenges in palliative care research; recruitment, attrition and compliance: experience from a randomized controlled trial. Palliat Med. 1999, 13: 299-310. 10.1191/026921699668963873.

    Article  PubMed  Google Scholar 

  10. Council MR: A framework for development and evaluation of RCTs for complex interventions to improve health. 2000, London, Medical Research Council

    Google Scholar 

  11. Campbell M, Fitzpatrick R, Haines A, Kinmouth AL, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. Br Med J. 2000, 321: 694-696. 10.1136/bmj.321.7262.694.

    Article  CAS  Google Scholar 

  12. Compston A, Coles A: Multiple sclerosis. Lancet. 2002, 359: 1221-1231. 10.1016/S0140-6736(02)08220-X.

    Article  PubMed  Google Scholar 

  13. Higginson IJ, Vivat B, Silber E, Saleem T, Burman R, Hart S, Edmonds P: Study protocol: delayed intervention randomised controlled trial within the Medical Research Council (MRC) Framework to assess the effectiveness of a new palliative care service. BMC Palliat Care. 2006, 5: 7-10.1186/1472-684X-5-7.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Edmonds P, Vivat B, Burman R, Silber E, Higginson IJ: 'Fighting for everything': service experiences of people severely affected by multiple sclerosis. Mult Scler. 2007, 13: 660-667. 10.1177/1352458506071789.

    Article  CAS  PubMed  Google Scholar 

  15. Edmonds P, Vivat B, Burman R, Silber E, Higginson IJ: Loss and change: experiences of people severely affected by multiple sclerosis. Palliat Med. 2007, 21: 101-107. 10.1177/0269216307076333.

    Article  PubMed  Google Scholar 

  16. Gruenewald DA, Higginson IJ, Vivat B, Edmonds P, Burman RE: Quality of life measures for the palliative care of people severely affected by multiple sclerosis: a systematic review. Mult Scler. 2004, 10: 690-704. 10.1191/1352458504ms1116rr.

    Article  CAS  PubMed  Google Scholar 

  17. Perera R, Heneghan C, Yudkin P: Graphical method for depicting randomised trials of complex interventions. BMJ. 2007, 334: 127-129. 10.1136/bmj.39045.396817.68.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Roberts C, Torgerson D: Randomisation methods in controlled trials. BMJ. 1998, 317: 1301.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  19. Hearn J, Higginson IJ: Development and validation of a core outcome measure for palliative care: the palliative care outcome scale. Qual Health Care. 1999, 8: 219-227.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  20. Higginson IJ, Donaldson N: Relationship between three palliative care outcome scales. Health and Quality of Life Outcomes. 2004, 2: 68-75. 10.1186/1477-7525-2-68.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Higginson IJ, Hart S, Silber E, Burman R, Edmonds P: Symptom prevalence and severity in people severely affected by multiple sclerosis. J Palliat Care. 2006, 22: 158-165.

    PubMed  Google Scholar 

  22. Hobart JC, Riazi A, Lamping DL, Fitzpatrick R, Thompson AJ: Improving the evaluation of therapeutic interventions in multiple sclerosis: development of a patient-based measure of outcome. Health Technol Assess. 2004, 8 (9): iii, 1-48.

    Article  Google Scholar 

  23. Hobart JC, Riazi A, Lamping DL, Fitzpatrick R, Thompson AJ: How responsive is the Multiple Sclerosis Impact Scale (MSIS-29)? A comparison with some other self report scales. J Neurol Neurosurg Psychiatry. 2005, 76: 1539-1543. 10.1136/jnnp.2005.064584.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  24. Rossier P, Wade DT: The Guy's Neurological Disability Scale in patients with multiple sclerosis: a clinical evaluation of its reliability and validity. Clin Rehabil. 2002, 16: 75-95. 10.1191/0269215502cr447oa.

    Article  PubMed  Google Scholar 

  25. Rossier P, Wade DT: Validity and reliability comparison of 4 mobility measures in patients presenting with neurologic impairment. Arch Phys Med Rehabil. 2001, 82: 9-13. 10.1053/apmr.2001.9396.

    Article  CAS  PubMed  Google Scholar 

  26. Weinshenker BG, Rice GP, Noseworthy JH, Carriere W, Baskerville J, Ebers GC: The natural history of multiple sclerosis: a geographically based study. 3. Multivariate analysis of predictive factors and models of outcome. Brain. 1991, 114 ( Pt 2): 1045-1056. 10.1093/brain/114.2.1045.

    Article  CAS  Google Scholar 

  27. Robinson L, Francis J, James P, Tindle N, Greenwell K, Rodgers H: Caring for carers of people with stroke: developing a complex intervention following the Medical Research Council framework. Clin Rehabil. 2005, 19: 560-571. 10.1191/0269215505cr787oa.

    Article  PubMed  Google Scholar 

  28. Hanks GW, Robbins M, Sharp D, Forbes K, Done K, Peters TJ, Morgan H, Sykes J, Baxter K, Corfe F, Bidgood C: The imPaCT study: a randomised controlled trial to evaluate a hospital palliative care team. Br J Cancer. 2002, 87: 733-739. 10.1038/sj.bjc.6600522.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  29. Jordhoy MS, Fayers PM, hlner-Elmqvist M, Kaasa S: Lack of concealment may lead to selection bias in cluster randomized trials of palliative care. Palliat Med. 2002, 16: 43-49. 10.1191/0269216302pm523oa.

    Article  CAS  PubMed  Google Scholar 

  30. Grande GE, Todd CJ, Barclay SIG, Farquhar MC: A randomised controlled trial of a hospital at home service for the terminally ill. Palliat Med. 2000, 14: 375-385. 10.1191/026921600701536200.

    Article  CAS  PubMed  Google Scholar 

  31. Brennan L, Walkley J, Fraser SF, Greenway K, Wilks R: Motivational interviewing and cognitive behaviour therapy in the treatment of adolescent overweight and obesity: Study design and methodology. Contemp Clin Trials. 2007

    Google Scholar 

  32. Sofronoff K, Attwood T, Hinton S, Levin I: A randomized controlled trial of a cognitive behavioural intervention for anger management in children diagnosed with Asperger syndrome. J Autism Dev Disord. 2007, 37: 1203-1214. 10.1007/s10803-006-0262-3.

    Article  PubMed  Google Scholar 

  33. Doiron JP, Nicki RM: Prevention of pathological gambling: a randomized controlled trial. Cogn Behav Ther. 2007, 36: 74-84. 10.1080/16506070601092966.

    Article  PubMed  Google Scholar 

  34. Flegal KE, Kishiyama S, Zajdel D, Haas M, Oken BS: Adherence to yoga and exercise interventions in a 6-month clinical trial. BMC Complement Altern Med. 2007, 7: 37-10.1186/1472-6882-7-37.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  35. Higginson IJ, Wade AM, McCarthy M: Effectiveness of two palliative support teams. J Public Health Med. 1992, 14: 50-56.

    CAS  PubMed  Google Scholar 

  36. Stein BD, Jaycox LH, Kataoka SH, Wong M, Tu W, Elliott MN, Fink A: A mental health intervention for schoolchildren exposed to violence: a randomized controlled trial. JAMA. 2003, 290: 603-611. 10.1001/jama.290.5.603.

    Article  PubMed  Google Scholar 

  37. Addington-Hall JM, MacDonald LD, Anderson HR, Chamberlain J, Freeling P, Bland JM, Raftery JP: Randomised controlled trial of effects of co-ordinating care for terminally ill cancer patients. BMJ. 1992, 305: 1317-1322.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  38. Kane RL, Wales J, Bernstein L, Leibowitz A, Kaplan S: A randomised controlled trial of hospice care. Lancet. 1984, 1: 890-894. 10.1016/S0140-6736(84)91349-7.

    Article  CAS  PubMed  Google Scholar 

  39. Groenvold M: Methodological issues in the assessment of health-related quality of life in palliative care trials. Acta Anaesthesiol Scand. 1999, 43: 948-953. 10.1034/j.1399-6576.1999.430912.x.

    Article  CAS  PubMed  Google Scholar 

  40. Hopwood P, Stephens RJ, Machin D: Approaches to the analysis of quality of life data: experiences gained from a medical research council lung cancer working party palliative chemotherapy trial. Qual Life Res. 1994, 3: 339-352. 10.1007/BF00451726.

    Article  CAS  PubMed  Google Scholar 

  41. Palmer JL: Analysis of missing data in palliative care studies. J Pain Symptom Manage. 2004, 28: 612-618. 10.1016/j.jpainsymman.2004.02.026.

    Article  PubMed  Google Scholar 

  42. Peruselli C, Paci E, Franceschi P, Legori T, Mannucci F: Outcome evaluation in a home palliative care service. J Pain Symptom Manage. 1997, 13: 158-165. 10.1016/S0885-3924(96)00320-X.

    Article  CAS  PubMed  Google Scholar 

  43. McWhinney IR, Bass MJ, Donner A: Evaluation of a palliative care service: problems and pitfalls. BMJ. 1994, 309: 1340-1342.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Pre-publication history

Download references

Acknowledgements

We thank the MS Society whose funding made this project possible; the staff involved in data collection, interviewing and other aspects of the study, including Bella Vivat, Troy Cartwright, Gay Foxwell, Barbara Gomes, Farida Malik and Michael Walton; Juan Gonzales and Nora Donaldson for support in statistical methods and randomisation; the Project Advisory Committee (Keith Andrews, Fiona Barnes, Cynthia Benz, Colin Campbell, Sharon Haffenden, Martin Hunt, Robin Luff, David Oliver, Michael Ritchie, Sally Plumb, Carolin Seitz) who oversaw the development of methods and trial conduct. Most importantly we thank the patients and families for sharing their thoughts, experiences and concerns with us. Special thanks are also due to Dr Massimo Costantini who originally suggested using a wait list randomised controlled trial.

The MS Society selected those people affected by MS to be members of the PAC, one of whom chaired the PAC, to ensure user representation in the study. Research managers from the MS Society were in attendance at the PAC to observe progress, and provide a link to other MS Society activities. All execution of the work, data collection, analysis and interpretation and writing of results is completely independent of the funders.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Irene J Higginson.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

IJH co-conceived the study and design, co-applied for funding, oversaw all study conduct and developed the analysis plan. PE co-conceived the study and design, led the application for funding and oversaw all conduct of the study. ES co-applied for funding and contributed to the design and study conduct, as well as providing neurological service. TS was an interim research fellow on the project, and helped to refine interview techniques in phase II. RB was appointed as consultant to the service, conducted and analysed interviews for phase I, collected clinical data and oversaw the clinical service activity. SH was appointed as research associate on the project, entered and analysed data in phase II, and contributed to the design of and ethics submission for the post interview survey. SH, TS, IJH and PE all conducted interviews in phase II. IJH led the drafting of this paper (working closely with PE, RB and SH). All other authors saw or contributed to or commented on the final draft. IJH acts as guarantor.

Electronic supplementary material

Authors’ original submitted files for images

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Higginson, I.J., Hart, S., Burman, R. et al. Randomised controlled trial of a new palliative care service: Compliance, recruitment and completeness of follow-up. BMC Palliat Care 7, 7 (2008). https://doi.org/10.1186/1472-684X-7-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1472-684X-7-7

Keywords