Skip to main content

Using normalization process theory to evaluate the use of patient-centred outcome measures in specialist palliative home care—a qualitative interview study

Abstract

Background

Standardised use of patient-centred outcome measures (PCOMs) improves aspects of quality of care. Normalization Process Theory (NPT) considers the social (inter-)actions of implementation processes operationalised through four constructs: coherence-building, cognitive participation, collective action and reflexive monitoring. The aim of the study was to identify barriers and enablers for the successful use of PCOMs in specialist palliative home care (SPHC) using NPT, to collect clinically meaningful and reliable data to improve patient outcomes.

Methods

Qualitative study using semi-structured interviews with palliative care professionals from German SPHC teams who participated in a study using PCOMs. Data were analysed using Framework analysis, and contextualised within NPT.

Results

Seventeen interviews across five teams were conducted. Some teams already had an understanding of what PCOMs are and how to use them, based on previous experience. In other teams, this understanding developed through the perception of the benefits (coherence). Participation and engagement depended on individuals and was decisive for coherence-building. The attitude of the management level also played a major role (cognitive participation). Integration of PCOMs into everyday clinical practice varied and depended on the manifestation of the first two constructs and other already established routines (collective action). In the context of appraisal, both positive (e.g. focus on patient) and negative aspects (e.g. additional work) of using PCOMs were mentioned (reflexive monitoring).

Conclusions

Although benefits of using PCOMs were partly recognised, not all teams continued standardised use. Here, not only the social (inter-)actions, but also the influence of the context (working environment) were decisive. Future implementation strategies should consider integrating PCOMs in existing electronic patient records, education sessions supporting coherence-building, internal facilitators/local champions, and ensuring frequent data analyses as it is beneficial and increases the readiness of using PCOMs.

Peer Review reports

Background

Outcome measurement has become increasingly important in clinical palliative care. It delivers relevant information about the condition and situation of patients and relatives, providing a system to evaluate and improve palliative care. Measuring outcomes is not only helpful to identify needs, monitor symptoms and take clinical action, their use also enhances communication between clinicians and patients [1,2,3,4,5]. Preferably, outcomes are measured by standardised and validated questionnaires, that are self-reported by the patient and in which they assess their state of health (wellbeing and functional status) and quality of life in response to individual questions. [6, 7] However, in palliative care the use of patient-reported outcome measures (PROMs) can be challenging as patients often become increasingly unwell and are in many cases not able to self-report their symptoms, needs, and wishes due to high symptom/problem burden, cognitive impairment, or unconsciousness. To avoid exclusion of these vulnerable patient groups, patient-centred outcome measures (PCOMs), which also focus primarily on aspects that are important for patients and their relatives, can be used with the possibility of proxy-reporting by, for example, healthcare professionals [1, 7, 8].

In Australia, the Palliative Care Outcome Collaboration (PCOC) is a national program funded by the Australian government to enable outcome measurement and benchmarking [9]. In addition, Australia has an established funding model for palliative care based on case-mix [10,11,12]. In the UK, various initiatives, e.g. the Outcome Assessment and Complexity Collaboration (OACC) [13] or RESOLVE also aim to implement outcome measurement [8]. Although using outcome measures improves the quality of palliative care and is necessary for comparisons across services, the implementation of outcome measures is not yet established in a standardised and comprehensive way in specialist palliative care [14]. Barriers described include, for example, lack of knowledge about benefits, lack of training for users, lack of role models to encourage use, or fear of additional work and resulting lack of time [15, 16].

In Germany, the nationwide research project COMPANION (development of a patient-centred complexity and casemix classification for adult palliative care patients based on needs and resource use) used PCOMs in three specialist palliative care settings (palliative care unit, hospital advisory team and specialist palliative home care (SPHC)). The aim of the COMPANION project was to develop a German complexity and casemix classification for palliative care patients based on needs and resource use [17]. Its application will require the continuous and comprehensive use of PCOMs by healthcare professionals. Therefore, an implementation strategy tailored to the working environment of specialist palliative care needs to be applied, based on in-depth understanding of the processes behind. To facilitate this, it is necessary to assess, within a theoretical construct, the users' perspective on how the standardised use of PCOMs can be realised [18].

Normalization Process Theory (NPT) according to May and Finch (2009) is a sociological behavioural theory describing how likely it is that new practices, in this case using PCOMs, will be successfully adopted based on the characteristics of four interrelated constructs. It aims to theorise the process of how innovations (using PCOMs) become routines in everyday work and are thus normalised. NPT focuses on social (inter-)actions and thus on work that needs to be done by individuals or groups involved. These social (inter-)actions are operationalised through four constructs: coherence-building, cognitive participation, collective action and reflexive monitoring (see Table 2) [18, 19]. McNaughton et al. described these constructs in their qualitative study as ‘making sense of it’, ‘working out participation’, ‘doing it’, and ‘reflecting on it’ to make them more usable [20]. Furthermore, May and Finch locate the four constructs in the Context-Mechanism-Outcome (CMO) approach of ‘Realist Evaluation’, which is based on the assumption that the implementation context (environment teams operate in) influences the (inter-)actions (mechanisms) and thus the outcome (effects) of implementation work. The inclusion of the context which might be enabling or not, and how this may interact with the mechanisms to achieve a particular outcome, is considered as important [21].

Due to various regulatory structures and processes in German specialist palliative care, even services in the same setting can be heterogeneous, which is especially the case in SPHC [22, 23]. To address this, we focused on evaluating the use of PCOMS in the SPHC setting across different federal states. Therefore, the aim of the study was to identify barriers and enablers for the successful use of PCOMs in SPHC using NPT, to collect clinically meaningful and reliable data to improve patient outcomes. Objectives were to explore attitudes and experiences of staff towards the understanding, relevance and applicability of PCOMs in everyday SPHC.

Methods

Design

Cross-sectional multi-centre qualitative study using semi-structured interviews. This paper has been written in accordance with the COREQ checklist (Additional file 1) [24].

Setting and participants

The COMPANION project collected data (between 01/2021 and 09/2022) on patients’ complexity documented electronically by healthcare professionals, if possible integrated in the existing electronic patient record (four teams integrated, two teams not integrated), over a three-month time period using several PCOMs (Additional file 2) [17]. Six SPHC teams participated in the COMPANION study, located in five different federal states across Germany. Teams were offered two education sessions by the COMPANION research team. Assessment was supported by pocket cards (describing how to use the measures) and a more in-depth manual describing the procedure for using the PCOMs in daily routine. Within the electronic documentation of PCOMs, it was possible to illustrate the assessed parameters in graphs. All teams had several monitoring meetings throughout data collection in the COMPANION study and received a final report on the analysis of collected patient outcomes presented by the research team.

For this qualitative study, which was conducted as an add-on in teams that participated in the COMPANION study, interview-participants, who used PCOMs to collect data on patients’ complexity, were recruited via phone or email by ELE. To cover a variety of views and experiences, and because of limited resources, purposive and convenience sampling was applied [25]. The sampling frame included professional groups (doctors, nursing staff and allied health professionals), management position, professional experience, age and gender (Additional file 3). Interviews took place approximately four weeks after the end of data collection of the COMPANION study to ensure that interviewees had sufficient time to gain experiences in using PCOMs in their daily routine, but that study-related experiences were still present. Interviews were conducted by ELE and FH by video call or phone as requested.

Interview guide

Interviews followed a semi-structured interview guide (Additional file 4). Participants were encouraged to share their own personal experiences, attitudes and perspectives and to include opinions/views of their team members as well. It was developed according to Helfferich’s four-step procedure: collecting, reviewing, sorting, summarising [26], and is partly based on the interview guide of the study by Bradshaw et al. [14] as well as on experiences made during the COMPANION data collection. It was discussed in a multidisciplinary research group focusing on structure and clarity of questions. Two test interviews (doctor and nurse working in palliative hospital advisory care participating in COMPANION) were conducted to obtain further information about the appropriateness of questions, duration of the interview, and whether the NPT concept was covered by the interview questions. No changes were necessary.

Data management and analysis

Interviews were audio recorded and transcribed verbatim, using transcription rules according to Dresing and Pehl; e.g. capital letters were used when the interviewees gave special emphasis to words [27]. The qualitative data management software MaxQDA 2022 (VERBI Software, 2021) was used to support analysis [28]. Data were analysed using content analysis, and by applying the framework method developed by Ritchie and Lewis [29]. The framework analysis aims to develop a systematising matrix which summarises/reduces the data material and thus allows for transparent comparison [30]. A recently developed NPT coding manual for qualitative research by May et al. was used for theoretical framing. It aims to facilitate transparency in data analysis processes and to simplify the theory for users [21]. The data was first analysed inductively to identify themes and to avoid exclusion of themes; therefore three interviews were double coded and compared by ELE and FH. Second, ELE developed the coding tree (Additional file 5) deductively based on the coding manual, as the inductively identified themes could be well assigned within the coding manual. Four interviews were double coded (ELE) for intra-coder reliability within two months apart. Both coding tree and manual were discussed multiple times in an interdisciplinary research group.

Results

Overall, 17 interviewees were recruited in five participating teams (see Table 1). Teams were located in five different federal states across Germany, three teams in an urban area and two teams in a rural area. 17/20 persons accepted the invitation, one person did not respond at all. One team declined the interview request entirely due to lack of staff resources. Interviews lasted on average 29 min (range 13–55 min) and were conducted between January and August 2022. Median time between the end of the COMPANION data collection and the interviews was nine weeks (range between 4 and 16). Table 1 shows socio-demographic details. Within the participating teams, data saturation was reached as no new aspects were mentioned.

Table 1 Socio-demographic details of participants (n = 17)

All inductively developed codes could be verified within the NPT coding manual comprising 12 constructs, and corresponding to the Context-Mechanism-Outcome approach of Realist Evaluation [21]. Results are therefore presented as follows: Implementation Context, Implementation Mechanisms and Implementation Outcomes, which each are further divided into subcategories according to the NPT coding manual (see Table 2). Each section then describes how these (sub-)categories could be applied to the interview material.

Table 2 Main results based on the NPT coding manual [21] adapted to the application of PCOMs in SPHC

Implementation context

Implementation contexts deal with how the use of PCOMs is influenced by the environment the teams operate in, and consists of four further components. Strategic intentions of teams prior to the COMPANION study varied. Three teams wanted to use the study to test and possibly implement using PCOMs in their daily work, two teams had planned to only use them in the study from the beginning. Those two teams used a different software system for their daily documentation than the one used in the study. They therefore had to document twice, which had a negative impact on adaptive execution. Problems with software documentation were also mentioned as difficult in all teams, especially when loading was slow or over-savings happened through simultaneous documentation.

"We always do an initial assessment together, doctor and nurse. We are always consulting the patient together. With regards to the documentation, (…) there were a few difficulties, IT problems, who saves what and when? The data is directly IN there and you also have a baseline value. And THAT was a bit, yes, bumpy in the first phase, as it ALWAYS is. And then every team (doctor and nurse) had to readjust, right? In the first week, those were the challenges for me and I knew: OK, one team has somehow got it together in the first assessment, first one documents, THEN the other documents. (…) But with the NEXT team it didn’t work, because one had documented it before the other did and then the value was not in the basic assessment. So these were the very small problems that occurred at the beginning. Until everyone was THROUGH it, we had to find a way to make the documentation work.” (Doctor_No1_management-level, Pos. 30).

Negotiating capacity includes the way teams communicated and shared information, which impacts on usage and acceptance. PCOMs were perceived as helpful when teams conducted handovers text-based in digital form, and less helpful when they shared information in person or in weekly team meetings. Size of teams and staff fluctuation as well as the organisation of daily care routines also had an influence, e.g. whether teams were organised in a primary nursing system in which team members act as primary reference person for their patients and their relatives, or whether the staff member of reference changed daily.

“That's just the way it is, you don't see every patient, always just one and the same, but it changes both in the palliative care advisory service and on the ward as well as in the SPHC, to get this information from the previous health professional is, I think, extremely helpful.” (Doctor_No16_management-level, Pos. 40).

Furthermore, teams operate in different legal requirements and conditions, which relate to funding models, range of services, and staff-mix (teams consist of doctors and nurses only or include other professional groups, e.g. psychosocial). Two teams are independently organised and three are affiliated with a university hospital, which affected the hierarchical structures both between the management and the non-management level and between professional groups. Independently organised teams were described as less hierarchical, nurses felt more heard and communication in general tended to be more on eyelevel, which influenced how decisions regarding PCOMs were made. Reframing organisational logics focuses on existing social and social-cognitive resources. As this relates to coherence and attitude of the leadership/local facilitators, it is addressed under cognitive participation and initiation.

Implementation mechanisms

Coherence-building

Coherence-building (‘making sense of it’) deals with how people collectively and individually make sense of using PCOMs and is further divided into four subcategories. For differentiation, some PCOMs (e.g. pain assessments, functional status) were already used more or less in every team, mainly in the context of initial assessment on admission, but the main information was documented in text/progress reports. A standardised assessment and response framework for implementation into daily routine had not yet been implemented in any of the teams, so the application of PCOMs differed significantly from how teams have worked before. Previous experiences play a role, which are explained in the categories communal and individual specification. They could not be distinguished in the data material, are therefore summarised, and refer to statements about how participants have used PCOMs previously and experiences they have had with their use. Overall, feedback was that the application was unfamiliar at the beginning, but interviewees quickly got used to it, as assessing the patient's situation is part of their daily work and developing new routines simply took some time.

“To be honest, I have to say that I was concerned before we introduced it, because I saw great difficulties in applying it to every patient, including telephone contacts, and that it would perhaps also exceed the time frame, so that we would have much less time for the patients. To be honest, that HAS not turned out to be the case. The team came in very, very quickly, it has to be said. (…) And I was SURPRISED that a certain routine was established pretty quickly.” (Doctor_No1_management-level, Pos. 14).

However, difficulties were described, especially assessing psychosocial items and burden of relatives at the beginning of care, and that all professionals have the same understanding of the PCOMs and apply them consistently.

“When two staff members were involved, they had completely different assessments. And I always found this very telling of how difficult/what a learning process it is to have a common assessment. Because that is what we need, a common assessment of some kind, so that we can also assess the process and so that I can say: "Oh, okay, not only because person A saw it that way, then I know, ah, person A always sees it that way", but that we somehow find a common language and, yes, evaluation.” (Doctor_No10, Pos. 36–38).

Furthermore, it was described that in SPHC contact is not as regular as in the inpatient setting; usually situations are dynamic, often change and frequently only snapshots are possible; teams operate as guests in a patient’s home environment and not all patients and relatives understand what SPHC includes, e.g. talking about psychosocial issues.

“I think when I work in the hospital, I have completely different (prerequisites)/I always think when I'm at home, I'm a GUEST. And then I see so MUCH within a very short time, I have such a broad view then. But in the hospital I already have so much structure that I can categorise much more and much faster. And that is simply much more difficult at home.” (Nurse_No17_management-level, Pos. 54–60).

It was described to be challenging to assess the end of care episodes when patients died and professionals were not present. Another criticism of PCOMs was that the individuality of care and the quality of symptoms cannot be represented, and there was concern about loss of time for patients due to the more time-consuming documentation.

“What I'm missing, for example, starting at the top with pain, is that the symptom itself doesn't reflect any quality, yes? So is it tearing now, is it burning now? So I have/must have noted somewhere then, what kind of pain is it right now?” (Nurse_No9, Pos. 36–42).

Internalisation and thus the recognition of value took place when users recognised their own/clinical benefit from using PCOMs or not when benefits were not recognised. Aspects mapped in the components cognitive participation (legitimation) and collective action (interactional workability) are relevant for this process. However, it may also be possible that meaning was not recognised because of one’s attitude towards palliative care, that it should not be operationalised due to the individuality and therefore text/progress reports were perceived as more important and valuable.

“It is becoming clear that we have not adopted any of this. And so there have been lively discussions here over and over again, (…) because we have just found that it is not individual enough.” (Nurse_No17_management-level, Pos. 18).

Cognitive participation

Cognitive participation (‘working out participation’) deals with how people participate in order to use PCOMs. Initiation is about the role leadership/local facilitators took on, and different approaches could be identified. One approach is characterised by an active role with open communication about expectations and long-term use of PCOMs. The team was involved in decisions, and training in the use of PCOMs was offered during working hours. In these teams coherence at management level was present and well developed.

“And that was actually quite clear to us, everyone should take a look at it. This is working time for all employees. It doesn't matter whether you were on duty on the day of the introduction or not. If you looked at it later, you do that during your working hours, that was PLANNED. And that was certainly very GOOD.“ (Doctor_No10, Pos. 34).

In another team coherence was not well developed at the beginning, but the management level was open to using PCOMs, applied them themselves and initiated discussions about them. In one team, the management level was sceptical and little sense was seen in the application, which was reflected in the fact that there was no open communication, and the team was not involved in decisions. In two teams, management level did not take on a special role.

In terms of enrolment, statements about the guidance provided by the research team, training, and training materials were included. Availability and support of the research team was considered positive, as were pocket cards as part of training materials with brief information provided. Manuals were used less because they were considered too extensive. Views on education sessions conducted by the research team were divided, some considered them too theoretical, others good and helpful.

An aspect of cognitive participation is the legitimation of using PCOMs. This is mainly about personal processes of each individual and how people engage with new things.

“And there, too, it's very different. One person says: "I'll do it once", and immediately says: "Ah, that's all stupid. That is/" Because at first it is of course more difficult when I leave my familiar environment and have to document. The other person might take three, four, five home visits and then says afterwards: "That's good".” (Nurse_No7_management-level, Pos. 18).

Another factor was whether participants recognised their own benefit through using PCOMs, e.g. a quick overview of the situation through a graphical display, focussing holistically on patient/family, or availability of data across settings. The last aspect involves activation. All teams discussed whether their measurements were reliable, e.g. how much they differed between professionals. Naming a responsible person as an internal facilitator/champion was particularly helpful and necessary in case of questions or uncertainties.

Collective action

Collective action (‘doing it’) is concerned with how people integrate PCOMs into their daily work. Interactional workability addresses how participants described their use of PCOMs in their everyday work. The predefined structure of PCOMs was used in consultations with patients and relatives, for example in taking the medical history, which was considered to be helpful as all items had to be captured; therefore no important issues were forgotten and all dimensions of care (physical, psychological, social and spiritual) were covered.

“I think that if you use them in a way (…) that they are FUNCTIONAL, no, that you really ask yourself what do I want to KNOW, no, then they are absolutely helpful. So just for the sake of completeness, not to forget anything and also to bring a certain system into history taking.” (Doctor_No16_management-level, Pos. 13–14).

PCOMs led to a content-related discussion in the team about symptoms/problems, actions were derived from it and their effectiveness was evaluated.

“AND THEN we only ever corrected THINGS that had changed. And we also talked about it like this, yes, okay, if we now see a new pain that is now suddenly at FOUR, we have to somehow try to get a grip on it within two or three days. Does that happen?” (Doctor_No11_management-level, Pos. 43–44).

The graphical display was used to get a quick overview of symptoms/problems, which was considered especially helpful during on-call times or to prepare for home visits.

“When I use it, I find it very nice to have this overview. It's almost like a kind of medical chart that opens up afterwards, with the different colours, where I can see at a glance in which areas there are changes, improvements or deteriorations. I think that's very nice. So that gives me an overview and I like to work with that.” (Nurse_No9, Pos. 34).

PCOMs led to the same language being spoken, helped to adopt a common attitude in the team, and documentation could be reduced and simplified. Palliative care phases were used to prioritise care and to get an overview of the situation of all patients. However, there was also feedback from individual participants that PCOMs were not used at all and only assessed for the study. Interviewees mentioned that in terms of relational integration using PCOMs created a responsibility for everyone, as colleagues relied on correct measurement.

“And of course you can also transfer the responsibility here in that, as I assess something, the next person who takes over my patients also assumes that this is the assessment of the (deleted—own name) and then it fits.” (Nurse_No17_management-level, Pos. 12).

Skill-set workability was fulfilled as in most teams PCOMs were divided according to expertise, for example need for care in everyday life was assessed by nurses. From the interview with the psychologist/social worker it emerged that PCOMs were considered too medical and therefore less suitable for the psychosocial field.

“I have experienced these tools (…) in a way, I was also present at the introduction that it primarily had, I say, medical-nursing aspects. So it was designed more FOR doctors and nurses. That's how I experienced it. (…) And I, as a psychologist, but also within the framework of the psychosocial service, I have social services AND psychological conversations, which I do, I did NOT feel addressed in this way. (Psychosocial_No8, Pos. 4).

Resources were made available in all teams and overtime resulting from using PCOMs was accepted. Nevertheless, individual staff members would have liked more time for familiarisation (contextual integration).

Reflexive monitoring

How people individually and collectively appraised using PCOMs is considered in the section reflexive monitoring (‘reflecting on it’). The first aspect systematisation refers to whether participants got insights into the analyses of the collected data material. This was provided by regular feedback and a final report of the COMPANION study, which was evaluated positively. However, it was criticised that a presentation of the situation at beginning and end of care was not helpful, but that the depiction of care trajectories is needed. So far, no further analyses were conducted in any team beyond the study-related period. Communal appraisal was predominantly positive. Aspects mentioned were that the focus was directed comprehensively to patients, furthermore to symptom burden and the whole care concept/system including the relatives.

“I/we found it absolutely great that the focus was shifted AWAY from the, let's say, four to six main symptoms of palliative care to a broader spectrum. Because it made us quite often look again at points with the patients or ask questions, investigate, which we didn't have in mind before and maybe wouldn't have grasped at all if we had only had our standard like that. I/we definitely appreciated THAT. And ALSO the focus on psychosocial items was actually by far too neglected in our everyday working life before, I think. (…) And it has often led us in the TEAM, in team meetings, to think about these points again and to look again at where we have a different approach to the patients.” (Doctor_No10, Pos. 18).

Time savings through shortened documentation were described, and that reading progress reports also required less time as a result. In addition, the structure of PCOMs can save time in consultations, so that more time is available for other topics. By using standardised PCOMs, a common and uniform language can be spoken, the same data provided and used across settings, thus avoiding loss of information. Major negative aspects mentioned were that using PCOMs can create an additional time burden and additional work. In the context of individual appraisal, it was noted which further benefits the participants could imagine. It was mentioned that PCOMs could serve as screening instruments to identify palliative care needs, to make the activities of SPHC visible, to enable comparisons between services, and to generate transparent data for third parties, such as research or health insurance providers. Furthermore, it was suggested that other people, such as professionals in nursing homes or relatives, should be involved in measuring outcomes. Reconfiguration has taken place to varying degrees. Two teams completely changed documentation in line with the study because they considered it to be advantageous. One team has changed documentation due to a decision of the management level and another one integrated palliative care phases into their new electronic patient record. Only one team kept its old documentation, but individuals apply PCOMs they already used before more consistently.

Implementation outcomes

The last section of the NPT coding manual deals with how things change when interventions are implemented. This cannot be answered on the basis of the data material, as PCOMs have not been used long-term.

Discussion

In this study, we identified clearly enabling and normalising factors. These were open communication, internal facilitators/champions for application, leadership involvement and management configuration, suitable feedback of the outcome measurements, and better understanding of patients’ and relatives’ needs. In contrast, there were also barriers including the lack of assessing psychosocial aspects, subjectivity of scoring, attitude of individuals, difficulty of use and integration in the electronic documentation system, size and fluctuation of teams, and organisation of care.

Bradshaw et al. reported similar findings in their qualitative study with healthcare professionals in the UK in terms of the subjectivity of scoring, and understanding the benefits of outcome measures. They also emphasized the importance of technical implementation and that data collected is analysed and returned to the teams in an appropriate way [14]. In addition, results are comparable to Sandham et al., who interviewed practitioners in SPHC in New Zealand, and concluded that outcome measures provide structure, lead to a holistic view of the patient, help to focus more on psychosocial needs and to develop a common clinical language [31]. A recent study from Germany by Seipp et al. evaluated the implementation of patient-reported outcome measurement (PROM) in SPHC for care quality evaluation in one federal state. They report that SPHC teams accepted PROMs in their daily working life and recognized the benefit for quality evaluation, but the usefulness of the measurement responses for their practical work was lacking. Furthermore, staff members reported difficulties in assessing PCOMs [32]. The results of our study demonstrate that benefits of using PCOMs in clinical practice are recognised under certain circumstances, e.g. when integrated in existing electronic patient record and graphically displayed. Both studies show that using outcome measures has been established differently in teams, even though they all provide SPHC—suggesting that in some teams it might be easier to implement outcome measurement than in others. The individuality of teams, their organisation of work, and context in everyday life play a major role, which is in line with Seipp et al. as they emphasise the importance of taking individual team characteristics into account.

PCOC in Australia, in which 177 (an estimated 90%) palliative care services voluntarily participated in 2021 [33], developed a three-stage implementation guide to address challenges in terms of implementation. First, the readiness of the institution/team is checked by assessing the readiness containing requirements for participation, including definition of procedures, roles, and responsibilities. Based on the assessment, an implementation plan is developed including the support of senior executive staff, the selection of champions to facilitate local implementation and work with PCOC Facilitators (e.g. facilitators employed by PCOC and external to the organisation) and to develop workflows including communication processes in teams. As the guide is designed for leaders, it is apparent that they have a special responsibility, which is in line with the results of our study as well as other aspects mentioned. The second stage towards implementation and standardised use can only be started when all requirements in the readiness assessment have been completely fulfilled [34].

Demonstrating patient-centred outcomes will become increasingly important in the future, and required by funding agencies in Germany in the long term. Considering that applying PCOMs has clinical benefits and collecting meaningful and reliable data is a prerequisite for the application of casemix classifications, tailored implementation strategies that break down existing barriers and foster facilitating factors should be developed. A particular challenge will be to implement PCOMs in teams, whose working environment (context) appears less suitable for application. Therefore, it might be helpful to bring them together with teams where the application works well and is beneficial, to learn from each other. Building coherence is paramount and thus understanding the meaningfulness and recognising advantages for individuals and the team. This is not only related to direct patient care and cooperation but also in a broader sense to generate data to demonstrate the effectiveness of palliative care and serve quality assurance. For this purpose, structures need to be developed that the collected data can be analysed in a standardised way and thus made usable for the teams.

Based on the knowledge and consideration of static qualities of the context and their determinants to successful implementation, the Consolidated Framework for Implementation Research (CFIR) might be helpful in a next step to address these challenges. Schroeder et al. have shown that the interplay of NPT (including dynamic implementation processes) and CFIR (including static qualities) is helpful in understanding and clarifying how innovations find their way into routine practice [35].

Strengths and limitations of the study

A strength of the study is the inclusion of views of different professional groups at both management and non-management levels in five SPHC teams across five states in Germany. A weakness is the limited availability of professionals with psychosocial background with only one interview. However, many SPHC teams are only working with two professional groups (restricted by German regulation for SPHC) and the results therefore reflect the care structures in Germany. Another potential weakness is an unbalanced gender ratio. Nevertheless, we assume that this was compensated by the variance of the other sampling criteria. Furthermore, the COMPANION study might have influenced using PCOMs in clinical practice. However, we believe that this did not influence the results of this study, as difficulties in the application of the outcome measures were mentioned and criticism about the use was also voiced. To minimise socially desirable responses (measurement bias), the interviews in the SPHC teams that were supervised by ELE in the COMPANION data collection were conducted by FH. Lastly, the pandemic may have led to a different perception of the application of PCOMs in clinical practice and this may have had an influence on the response behaviour of interviewees. Since the results correspond with other studies, we do not assume that this is the case. In addition, not all interviews could be conducted shortly in time after the end of the COMPANION data collection due to the pandemic; however, we did not observe any effects on response behaviour and expect that this led to interviewees having more time to gain further experiences.

Conclusion

Benefits were partly realised by teams, and not all continued to use PCOMs standardised. For those that continued, social (inter-)actions and attitudes among team members and leadership were decisive. The context of teams’ further influenced successful use. Future implementation strategies should especially consider the integration of PCOMs in existing electronic patient records, education and training sessions that support coherence-building (recognition of benefits), internal facilitators/local champions, and ensuring frequent analyses of collected data as it is beneficial for the teams.

Availability of data and materials

The datasets generated and/or analysed during the current study are not publicly available due [data agreement reasons: interview manuscripts cannot be anonymised entirely, the interviewees’ anonymity would not be guaranteed] but are available from the corresponding author on reasonable request.

Abbreviations

PROMs:

Patient-reported outcome measures

PCOMs:

Patient-centred outcome measures

NPT:

Normalization Process Theory

SPHC:

Specialist palliative home care

PCOC:

Palliative Care Outcome Collaboration

OACC:

Outcome Assessment and Complexity Collaboration

CMO:

Context-Mechanism-Outcome

COREQ:

COnsolidated criteria for REporting Qualitative research

PROM:

Patient-reported outcome measurement

CFIR:

Consolidated Framework for Implementation Research

References

  1. Etkind SN, Daveson BA, Kwok W, Witt J, Bausewein C, Higginson IJ, et al. Capture, transfer, and feedback of patient-centered outcomes data in palliative care populations: does it make a difference? A systematic review. J Pain Symptom Manage. 2015;49(3):611–24.

    Article  PubMed  Google Scholar 

  2. Currow DC, Allingham S, Yates P, Johnson C, Clark K, Eagar K. Improving national hospice/palliative care service symptom outcomes systematically through point-of-care data collection, structured feedback and benchmarking. Support Care Cancer. 2015;23(2):307–15.

    Article  PubMed  Google Scholar 

  3. Dudgeon D. The impact of measuring patient-reported outcome measures on quality of and access to palliative care. J Palliat Med. 2018;21(S1):S-76-S−80.

    Article  Google Scholar 

  4. Milazzo S, Hansen E, Carozza D, Case AA. How effective is palliative care in improving patient outcomes? Curr Treat Options Oncol. 2020;21(2):1–12.

    Article  Google Scholar 

  5. Bausewein C, Daveson BA, Currow DC, Downing J, Deliens L, Radbruch L, et al. EAPC White Paper on outcome measurement in palliative care: Improving practice, attaining outcomes and delivering quality services–Recommendations from the European Association for Palliative Care (EAPC) Task Force on Outcome Measurement. Palliat Med. 2016;30(1):6–22.

    Article  PubMed  Google Scholar 

  6. Dawson J, Doll H, Fitzpatrick R, Jenkinson C, Carr AJ. Routine use of patient reported outcome measures in healthcare settings. BMJ. 2010;340:c186.

  7. Addington-Hall J, Kalra L. Who should measure quality of life? BMJ. 2001;322(7299):1417–20.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  8. Bradshaw A, Santarelli M, Khamis AM, et al. Implementing person-centred outcome measures (PCOMs) into routine palliative care: A protocol for a mixed-methods process evaluation of The RESOLVE PCOM Implementation Strategy. BMJ Open 2021;11:e051904.

  9. Eagar K, Watters P, Currow DC, Aoun SM, Yates P. The Australian Palliative Care Outcomes Collaboration (PCOC)–measuring the quality and outcomes of palliative care on a routine basis. Aust Health Rev. 2010;34(2):186–92.

    Article  PubMed  Google Scholar 

  10. Eagar K, Green J, Gordon R. An Australian casemix classification for palliative care: technical development and results. Palliat Med. 2004;18(3):217–26.

    Article  PubMed  Google Scholar 

  11. Gordon R, Eagar K, Currow D, Green J. Current funding and financing issues in the Australian hospice and palliative care sector. J Pain Symptom Manage. 2009;38(1):68–74.

    Article  PubMed  Google Scholar 

  12. Green JP, Gordon R, Blanchard MB, Kobel C, Eagar K. Development of the Australian national subacute and non‐acute patient classification version 4 final report. Australian Health Services Research Institute. 2015;760. Available from: https://ro.uow.edu.au/ahsri/760.

  13. Witt J, Murtagh F, de Wolf-Linder S, Higginson I, Daveson B. Introducing the Outcome Assessment and Complexity Collaborative (OACC) Suite of Measures-A Brief Introduction. Kings College London. 2014.

  14. Bradshaw A, Santarelli M, Mulderrig M, Khamis A, Sartain K, Boland JW, et al. Implementing person-centred outcome measures in palliative care: An exploratory qualitative study using Normalisation Process Theory to understand processes and context. Palliat Med. 2021;35(2):397–407.

    Article  PubMed  Google Scholar 

  15. Antunes B, Harding R, Higginson IJ, EUROIMPACT. Implementing patient-reported outcome measures in palliative care clinical practice: a systematic review of facilitators and barriers. Palliative Med. 2014;28(2):158–75.

    Article  Google Scholar 

  16. Pinto C, Bristowe K, Witt J, Davies JM, de Wolf-Linder S, Dawkins M, et al. Perspectives of patients, family caregivers and health professionals on the use of outcome measures in palliative care and lessons for implementation: a multi-method qualitative study. Ann Palliat Med. 2018;7(Suppl 3):S137–50.

    Article  PubMed  Google Scholar 

  17. Hodiamont F, Schatz C, Gesell D, Leidl R, Boulesteix A-L, Nauck F, et al. COMPANION: development of a patient-centred complexity and casemix classification for adult palliative care patients based on needs and resource use–a protocol for a cross-sectional multi-centre study. BMC Palliat Care. 2022;21(1):1–9.

    Article  Google Scholar 

  18. Murray E, Treweek S, Pope C, MacFarlane A, Ballini L, Dowrick C, et al. Normalisation process theory: a framework for developing, evaluating and implementing complex interventions. BMC Med. 2010;8(1):1–11.

    Article  Google Scholar 

  19. May C, Finch T. Implementing, embedding, and integrating practices: an outline of normalization process theory. Sociology. 2009;43(3):535–54.

    Article  Google Scholar 

  20. McNaughton R, Steven A, Shucksmith J. Using normalization process theory as a practical tool across the life course of a qualitative research project. Qual Health Res. 2020;30(2):217–27.

    Article  PubMed  CAS  Google Scholar 

  21. May CR, Albers B, Bracher M, Finch TL, Gilbert A, Girling M, et al. Translational framework for implementation evaluation and research: a normalisation process theory coding manual for qualitative research and instrument development. Implement Sci. 2022;17(1):1–15.

    Article  Google Scholar 

  22. Wikert J, Gesell D, Bausewein C, Jansky M, Nauck F, Kranz S, et al. Specialist palliative care classification: typology development. BMJ Supportive & Palliative Care. 2022:bmjspcare-2021–003435.

  23. Alt-Epping B, Nauck F. Spezialisierte ambulante palliativversorgung (SAPV). Bundesgesundheitsblatt-Gesundheitsforschung-Gesundheitsschutz. 2015;58(4–5):430–5.

    Article  PubMed  Google Scholar 

  24. Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–57.

    Article  PubMed  Google Scholar 

  25. Etikan I, Musa SA, Alkassim RS. Comparison of convenience sampling and purposive sampling. Am J Theor Appl Stat. 2016;5(1):1–4.

    Article  Google Scholar 

  26. Helfferich C. 5 Interviewplanung und Intervieworganisation in: Die Qualität qualitativer Daten. Springer. 2011;4:167–93.

  27. Dresing T, Pehl T. Praxisbuch Interview, Transkription & Analyse Anleitungen und Regelsysteme für qualitativ Forschende: dr dresing & pehl GmbH; 2012. Available from: https://www.audiotranskription.de/wp-content/uploads/2020/11/Praxisbuch_08_01_web.pdf.

  28. VERBI, Software. MAXQDA 2022 [computer software]. Berlin: VERBI Software; 2021. Available from maxqda.com.

  29. Ritchie J, Lewis J, Nicholls CM, Ormston R. Qualitative research practice: A guide for social science students and researchers: Sage; 2013.

  30. Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. 2013;13(1):1–8.

    Article  Google Scholar 

  31. Sandham MH, Hedgecock E, Hocaoglu M, Palmer C, Jarden RJ, Narayanan A, et al. Strengthening Community End-of-Life Care through Implementing Measurement-Based Palliative Care. Int J Environ Res Public Health. 2022;19(13):7747.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Seipp H, Haasenritter J, Hach M, Becker D, Schütze D, Engler J, et al. State-wide implementation of patient-reported outcome measures (PROMs) in specialized outpatient palliative care teams (ELSAH): A mixed-methods evaluation and implications for their sustainable use. BMC Palliat Care. 2022;21(1):1–23.

    Article  Google Scholar 

  33. Health AIo, Welfare. Palliative care services in Australia Canberra: AIHW; 2023 Available from: https://www.aihw.gov.au/getmedia/9511ebc9-83fe-4aec-a1ea-7541387b8b47/AIHW-PCSiA-2022-Palliative-care-outcomes-page.pdf.aspx.

  34. Clapham S, Mastroianni F, Kable L, Joseph N, Connolly J. Implementing PCOC - A guide for services 2020 Available from: https://documents.uow.edu.au/content/idcplg?IdcService=GET_FILE&dDocName=UOW217213&RevisionSelectionMethod=latestReleased.

  35. Schroeder D, Luig T, Finch TL, Beesoon S, Campbell-Scherer DL. Understanding implementation context and social processes through integrating Normalization Process Theory (NPT) and the Consolidated Framework for Implementation Research (CFIR). Implement Sci Commun. 2022;3(1):1–16.

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the interviewees for their engaged participation.

Funding

Open Access funding enabled and organized by Projekt DEAL. The study did not receive any funding.

Author information

Authors and Affiliations

Authors

Contributions

Development of the design, interview guides and analysis: ELE, FH and MJ. Conduction of interviews: ELE and FH. First mapping of data, identification of codes and development of the coding guide: ELE and FH. Coding: ELE. ELE drafted the manuscript. SC, CB and FH critically reviewed the manuscript for important intellectual content and contributed with expertise to the discussion of results. MJ and SDL commented the draft. All authors provided critical comments on drafts of the manuscript and approved the final manuscript.

Corresponding author

Correspondence to Eva Lehmann-Emele.

Ethics declarations

Ethics approval and consent to participate

The study was performed in accordance with the relevant guidelines and regulations (Declaration of Helsinki). All participants gave written informed consent. Ethical approval for the study was sought and granted by the research ethics committee of Ludwig-Maximilians-University Munich (reference number 21–0736).

Consent for publication

Not Applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1. 

COREQ Reporting Checklist.

Additional file 2. 

Patient-centred outcome measures.

Additional file 3. 

Sampling frame.

Additional file 4. 

Interview guide.

Additional file 5. 

Coding tree.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lehmann-Emele, E., Jansky, M., Clapham, S. et al. Using normalization process theory to evaluate the use of patient-centred outcome measures in specialist palliative home care—a qualitative interview study. BMC Palliat Care 23, 1 (2024). https://doi.org/10.1186/s12904-023-01329-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12904-023-01329-8

Keywords