Developing a family-reported measure of experiences with home-based pediatric palliative and hospice care: a multi-method, multi-stakeholder approach
BMC Palliative Care volume 20, Article number: 17 (2021)
Many children with serious illnesses are receiving palliative and end-of-life care from pediatric palliative and hospice care teams at home (PPHC@Home). Despite the growth in PPHC@Home, no standardized measures exist to evaluate whether PPHC@Home provided in the U.S. meets the needs and priorities of children and their families.
We developed and conducted a preliminary evaluation of a family-reported measure of PPHC@Home experiences using a multi-method, multi-stakeholder approach. Our instrument development process consisted of four phases. Item identification and development (Phase 1) involved a comprehensive literature search of existing instruments, guidelines, standards of practice, and PPHC@Home outcome studies, as well as guidance from a PPHC stakeholder panel. Phase 2 involved the initial item prioiritization and reduction using a discrete choice experiment (DCE) with PPHC professionals and parent advocates. Phase 3 involved a second DCE with bereaved parents and parents currently receiving care for their child to further prioritize and winnow the items to a set of the most highly-valued items. Finally, we conducted cognitive interviews with parents to provide information about the content validity and clarity of the newly-developed instrument (Phase 4).
Items were compiled predominantly from three existing instruments. Phase 2 participants included 34 PPHC providers, researchers, and parent advocates; Phase 3 participants included 47 parents; and Phase 4 participants included 11 parents. At the completion of Phase 4, the Experiences of Palliative and Hospice Care for Children and Caregivers at Home (EXPERIENCE@Home) Measure contains 22 of the most highly-valued items for evaluating PPHC@Home. These items include “The care team treats my child’s physical symptoms so that my child has as good a quality of life as possible”, “I have regular access to on-call services from our care team”, and “The nurses have the knowledge, skills, and experience to support my child’s palliative or hospice care at home.”
The EXPERIENCE@Home Measure is the first known to specifically measure family-reported experiences with PPHC@Home in the U.S. Future work will include formal psychometric evaluation with a larger sample of parents, as well as evaluation of the clinical utility of the instrument with PPHC@Home teams.
Children with serious illnesses, which may or may not have potential curative or life-prolonging treatments but all-too-often result in death , are generally living longer [2,3,4] and are increasingly being cared for by their families at home [2, 5, 6] with the support of pediatric palliative and hospice care teams [2, 7, 8]. Pediatric palliative and hospice care at home, hereafter referred to as PPHC@Home, is palliative and hospice care provided primarily outside of the hospital, often integrating the care provided by different services in the home, outpatient, hospital, and hospice settings [9, 10]. PPHC@Home supports children and families by providing a wide spectrum of services, including pain and symptom management, psychosocial and emotional support for the child and family, on-call services, expressive and other therapies, and care coordination across medical and social service providers and institutions [9,10,11,12,13,14].
In the U.S., no standard model for PPHC@Home exists, but services are primarily provided by home hospice, home health care, or hospital-based pediatric palliative care (PPC) programs that conduct home visits. The composition of and services provided by these PPHC@Home programs are significantly influenced by state and local regulations and resources; therefore, PPHC@Home varies considerably across programs and geographic areas [9, 10, 15, 16].
In order to improve care for all children with serious illnesses and their families at home, the development of appropriate and feasible measures is critical . More specifically, a family-reported measure of PPHC@Home is needed. A measure of patient and family perceptions of and experiences with the care they receive would provide invaluable information regarding the care provided, including if services meet patient and family priorities and expectations, as well as areas of unmet need and potential improvement for individual patients and families. Ultimately, providers, researchers, policymakers, and other stakeholders could use this information to improve the quality of care within and across programs [18, 19].
While several family-reported measures have been developed to evaluate PPC provided in hospital and community settings for children, these instruments were developed for populations outside the U.S. [20,21,22], where aspects of care differ due to varying health care system structures, funding mechanisms, cultural norms, social policies, and provider practices . The application of these instruments to U.S.-based care may therefore not be appropriate. The one known existing instrument developed to measure PPHC@Home outcomes in a U.S-based program evaluates only one specific domain (namely, health-related quality of life) . The development of a comprehensive family-reported experience measure of PPHC@Home provided in the U.S. is necessary to ensure that care teams are meeting children’s and families’ most important needs and priorities.
The purpose of this project was to develop and conduct a preliminary evaluation of a family-reported measure of experiences with PPHC@Home using a multi-method, multi-stakeholder approach. Starting with a consensus-based conceptual framework (described below), the project was conducted in four phases: Phase 1 - Item identification and development; Phase 2 – Initial prioritization and reduction of items by PPHC professionals; Phase 3 – Final prioritiztion and reduction of items by parents; and Phase 4 - Cognitive interviewing with parents. Since each phase built on results from the previous phase, the methods and results for each phase are presented together (Phases 2, 3, and 4). The Children’s Hospital of Philadelphia’s (CHOP) Institutional Review Board approved this study.
We used the National Consensus Project’s (NCP) Clinical Guidelines for Quality Palliative Care (4th edition)  as a framework for this project. We adapted these general guidelines for the PPHC context using published PPC-specific practice guidelines [1, 17], standards of practice , and peer-reviewed literature , along with critical feedback by a panel of PPC stakeholders (providers and parent advocates), resulting in a total of 20 PPHC@Home domains (Table 1).
Phase 1: item identification and development
We identified items and developed the initial pool of items based on a comprehensive review of the literature on existing measures of PPHC@Home quality and outcomes. We conducted the initial biomedical librarian-assisted literature search in Medline/Pubmed, CINAHL, Scopus, and PsycINFO in February 2017 and updated this search in March 2018. Search terms included pediatric palliative, pediatric hospice, quality of care, quality measures, outcome measures, clinical assessment, tools, and instruments.
Out of nearly 200 papers, we identified three comprehensive instruments for evaluating PPC in the home and hospital settings in Canada, Germany, and Switzerland [20,21,22]. We supplemented the items from these instruments with additional items from four sources: first, the literature describing outcomes from PPHC@Home programs in the U.S. [11,12,13, 24, 27,28,29,30]; second, adult hospice quality measures [31, 32]; third, PPC-specific quality guidelines and standards of practice [1, 17, 26]; and fourth, general palliative care quality guidelines . We compiled over 100 items from these sources. After removing duplicate and irrelevant items, we ended up with a pool of 70 items (Fig. 1 - Item Selection Process). The research team aligned each item with one of the 20 domains of PPHC@Home (Table 1).
We then reviewed the 70 items with a panel of five PPHC stakeholders (physician, nurse practitioner, social worker, and two bereaved parents/parent advocates) from across the U.S. Based on the panel’s feedback, we revised items and added five new items for a total of 75 items for evaluation in Phase 2 (Fig. 1).
Phase 2: initial prioritization and reduction of items by PPHC professionals
To prioritize and reduce the number of candidate items for the measure, we conducted two discrete choice experiments (DCE). First, we conducted a DCE with PPHC professionals (providers, researchers, and parent advocates) to reduce the initial item pool (Phase 2). Second, we conducted a DCE with parent participants to further prioritize and winnow the items (Phase 3, described in the following section).
Overview of DCE
DCE is a quantitative, choice-based approach to understanding individuals’ stated preferences regarding choices related to healthcare [33,34,35,36,37,38] and consumer decision-making [39, 40]. We chose a DCE over other group consensus techniques like Delphi methods because of known limitations of these other techniques, including the limited ability to discriminate between similarly-rated items and issues with scale-use bias that are inherent within rating scales [41, 42]. We used the DCE approach to obtain quantitative estimates of the relative importance of each item and domain (i.e., importance scores), and to rank order and winnow items. We used a DCE with Bandit MaxDiff Scaling, which is an approach that oversamples top-rated items to increase the precision of estimates of these items [42, 43]. This approach also minimizes sample size requirements and decreases the cognitive and time burden placed on participants by allowing each participant to rate a sub-set of the overall item pool, using Thompson Sampling to select the items for each new respondent based on estimates of each item’s mean and variance from previous respondents [42, 43].
In both DCEs, participants were presented with sets of four items. Within each set, participants were instructed to choose which of the four items was the most important for supporting families caring for a child with serious illness at home, and which item was least important (Fig. 2 - Sample DCE Choice Set). This process was repeated across different sets, where participants chose the most and least important items among each set that contained a different four-item combination.
Sample size considerations
We used a DCE design that converges on stable estimates of the relative item scores with as few as 20 participants per subgroup [44, 45]. While no standard guidelines exist for defining sample sizes for these DCE studies, experts recommend simulation studies to test the effect of different sample sizes on the reliability of estimates . We used a bootstrap approach, with replacement, to draw samples of 20, 30, and 50 respondents from a previous DCE study, conducted by one of the co-authors (CF), with a sample of 200 parents of children with serious illnesses . We iterated this process 100 times for each of the three sample sizes and found that with a sample with as few as 30 respondents, high-rated items can be clearly differentiated from low-rated items. As a result, we aimed to recruit a minimum of 30 participants for each of the subsequent DCE phases (Phases 2 and 3).
Recruitment and data collection
Phase 2 participants were professionals who were recruited from hospital, community, and academic settings from the U.S. and Canada using the following inclusion criteria:
For health care providers: member of an interdisciplinary PPC or hospice team (nurses, physicians, advanced practice nurses, social workers, child life therapists, art therapists, bereavement counselors, chaplains); palliative care or hospice board certification (physicians, nurses, advanced practice nurses) or ≥3 years’ clinical experience in PPC or hospice (≥ 0.5 FTE); or established PPC researcher.
For parent advocates: employed by a health system or parent advocacy organization, and has or has had a child who received PPHC@Home services.
Parent advocates were chosen for involvement in this early phase of the research because of their unique perspective that is based not only on their personal experiences with PPHC@Home, but also by their professional experiences working alongside families, providers, and other stakeholders. Our goal was to recruit 32 interdisciplinary professionals and at least four parent advocates.
Participants were recruited by the principal investigator (PI; co-author JB) via email. Interested participants contacted the PI and were emailed a web link for the discrete choice survey. They provided electronic informed consent to participate. If surveys were not completed after 1 week, the PI sent an electronic reminder. Each participant evaluated a subset of 30 items out of the overall 75-item pool from Phase 1 that were displayed in 38 total sets, as well as the 20 PPHC@Home domains that were displayed in 15 sets, for 53 total sets. The entire survey took 30 to 35 minutes to complete.
We determined the average ratings and rankings of items using Lighthouse Studio Version 9.6.1 (Sawtooth Software, Inc., Provo, UT), which used an aggregate logit application to multinomial logistic regression in order to estimate the average (mean) probability of choosing each item as most or least important across all participants (represented as a raw logit score). Raw logit scores were transformed to a 0 to 100 probability scale, where the lowest-rated item has a score of zero and scores for all items summed to 100 [42, 47]. This transformation facilitates a readily interpretable comparison of items, as this transformed score indicates the relative importance of items on a common scale (i.e., importance scores); for example, an item that is given a score of four is perceived by respondents as being twice as important as an item with a score of two. We then applied the same analytic process to calculate importance scores for each of the 20 PPHC@Home domains (Table 1).
To winnow the number of items, we first rank-ordered the domains by domain importance scores and calculated a maximum number of items “allowed” in each domain based on these importance scores. To estimate this maximum allowance, we multiplied the domain importance score by a “budget” value of 50 items (that is, our target maximum number of items for evaluation in the subsequent phase). As a result, all domains had an item allowance between 1 and 5 items. We then rank-ordered items by item-importance score, and retained the top-ranked items from each domain based on each domain’s item allowance.
Thirty-four PPC professionals participated in this phase, representing all interdisciplinary roles and 3 parent advocates (Table 2). Fifty percent of these professionals practiced in a hospital-based setting (inpatient and outpatient), 26.5% worked primarily in the home setting, 5.9% worked in both home and hospital settings, and 8.8% were primarily in an academic setting. Over 60% of our sample had eight or more years of PPC or hospice experience.
Additional file 1 presents the top-ranked items, which included I trust the care team (Mean score 3.50; SE: 1.27), Access to on-call services from palliative care or hospice team (Mean score 3.04; SE: 1.26), and Care team helps me do the best for my child (Mean score 3.01; SE: 1.28). Lowest-ranked items included Care team helps prepare my child for school (Mean score 0.09; SE: 1.44), Care team keeps me informed about their arrival time (Mean score 0.07; SE: 1.50), and Care team helps with arranging transportation (Mean score 0.05; SE: 1.54).
In terms of relative importance, professionals rated the item I trust the care team (Mean score 3.50; SE: 1.27) as approximately twice as important as Care team helps me to advocate for my child’s needs (Mean score 1.80; SE: 1.30), which is twice as important as Care team provides support for my spiritual needs (Mean score 0.92; SE: 1.35) (Additional file 1).
The top three domains included Physical Aspects of Care: Symptom Management (Mean score 11.20; SE: 5.04), Psychological/Emotional Aspects of Care: Child (Mean score 10.55; SE: 5.04), and Psychological/Emotional Aspects of Care: Parent(s) (Mean score 8.21; SE: 5.01). Lowest-ranked domains included Social Aspects of Care: Child (Mean score 1.61; SE: 5.01), Practical Aspects of Care (Mean score 1.60; SE: 5.00), and Emotional Aspects of Care: Extended Social Network (Mean score 0.36; SE: 5.17) (domain scores not depicted).
Top-ranked items in each domain were retained based on each domain’s item allowance (Additional File 1; bolded items). Two new items were added to two domains, Physical Aspects of Care: Symptom Management and Psychological/Emotional Aspects of Care: Child, which had high importance scores, but not enough items in the item pool to fill these domains. In total, 42 items were retained for further evaluation (Fig. 1).
Phase 3: final prioritization and reduction of items by parents
Recruitment and data collection
Parents were recruited from the CHOP Pediatric Advanced Care Team’s (PACT) service area and from the online Courageous Parents Network (CPN), which is a virtual community of parents, families, and clinicians that provides information, skills, tools, and other resources to support parents and families during their child’s illness journey. Participants were English-speaking parents over the age of 18 who had a child with a serious illness and who was younger than 25 years at the time care was received. Parents whose child was currently receiving PPHC@Home, as well as bereaved parents whose child had previously received PPHC@Home, were included in this study. For bereaved parents, we did not specify requirements for minimum length of time since their child’s death. Previous research with bereaved parents and other family caregivers have found that participation in research is generally not distressing for participants [48, 49], even as soon as 2 weeks after the patient’s death . In agreement with previous studies, we believed parents should have the autonomy to decide whether or not they would participate [48, 49]. Additionally, while issues with memory and recall may occur over time, participants often remember details about poignant events like the death of a loved one . Since we were seeking parents’ overall impression of what was important/not important for families at home, rather than specific details about their child’s care, we did not limit the maximum length of time following a child’s death.
The PI identified CHOP-based participants with the assistance of PACT’s nurse coordinator and social worker and then contacted eligible parents by phone. Interested parents provided electronic informed consent and completed the web-based discrete choice survey concurrently by phone or in-person with the PI, or independently via a web link. The PI recruited participants from CPN with the assistance of CPN’s staff, who posted recruitment materials and promoted the study through CPN’s email database and social media page. Interested participants reached out to the PI via phone or email and completed the survey via an emailed web link. Parents were contacted a maximum of three times. All parents were compensated for their participation with a $30 gift card.
In the DCE survey, participants provided their most-least important ratings on a subset of 20 items out of the 42-item pool and on the 20 domains. Items were displayed in different combinations of four items per set over 20 sets, and domains were displayed in different combinations of four domains per set over 15 sets. Participants, therefore, rated 35 sets that took 20 to 30 min to complete.
We had three goals at this phase, namely to winnow the item pool to include only the highest-priority items, but also to ensure that in the final set of items, each domain was represented in a manner proportional to the rated importance of each domain, and that no single domain was over-represented. We therefore calculated weighted item scores, multiplying each item’s individual score by the importance score for the item’s associated domain, and capped each domain at a maximum of two items to avoid overrepresentation of any domain in the instrument. We then retained the top-rated items by weighted importance score, in keeping with the domain cap.
Forty-seven parents from 45 families participated in this phase. Participants had a mean age of 42.6 years (SD 8.5), and most were white (89.4%), college-educated (68.1% college graduates) mothers (93.6%). Most parents (87.2%) were married or partnered and 48.9% were employed full-time (Table 3).
Approximately 70% of parents were currently caring for their child at home, and over one-third of children received care at home for more than 2 years. Over 50% of children were between 10 and 25 years of age. While children had a range of diagnoses, 51.1% had a neuromuscular, neurologic, or mitochondrial disease and 48.9% had a genetic or congenital disease (note: disease groups not mutually exclusive). We did not systematically collect information about the child/family’s geographic location, although we know that participants received care in several geographic regions of the U.S. (Table 3).
Parent participants’ prioritization of the domains are described elsewhere . In brief, highest-ranked domains included Physical Aspects of Care: Symptom Management, Psychological/Emotional Aspects of Care: Child, and Care Coordination . We then calculated weighted item scores and retained the top 20 items. While we capped each domain at 2 items, some domains, as expected, did not have any top-ranked items and were thus removed from the instrument . Domains that were removed included Psychological/Emotional Aspects of Care: Sibling(s), Extended Social Network; Social Aspects of Care: Parent(s), Child; Practical Aspects of Care; Ethical and Legal Aspects of Care; Spiritual, Religious, and Existential Aspects of Care; and Cultural Aspects of Care. Top-ranked items by weighted score included Care team treats my child’s physical symptoms so that my child has as good a quality of life as possible, I feel prepared to treat my child’s symptoms at home, and My child can easily get necessary care (Table 4). In total, 20 items were retained for further evaluation in Phase 4 (Table 4; bolded items).
Phase 4: cognitive interviews with parents
To examine the clarity of items and the measure’s content validity, we conducted cognitive interviews  with 11 parents.
Recruitment and data collection
Parent participants met the same inclusion criteria as Phase 3, and a sub-group of participants were re-contacted from Phase 3. After agreeing to participate, parents engaged in an in-person, phone-based, or video-based interview with the PI. With consent, interviews were audio-recorded and professionally transcribed. The structured interviews included specific probes about each item and about the overall instrument. Participants provided their interpretation of each item, their feedback on the relevance of items and comprehensiveness of the overall instrument, and their perceptions of issues regarding the clarity of the items and the overall instrument. Participants were compensated for their participation with a $30 gift card.
We followed Knafl et al.’s (2007) protocol for analysis . We first summarized data item-by-item across participants to reflect parents’ understanding and interpretation of each item and to identify potential problems (e.g., limited applicability, unclear reference or perspective, problems with wording/tone) with each item. We then summarized item interpretations and problems in a summary matrix. The PI and co-author JD reviewed all items and decided whether to retain, revise, or omit each item and whether to add new items. These decisions were discussed with the research team.
Eleven parents participated, two of whom also participated in Phase 3. Participants’ sociodemographic and children’s clinical characteristics resembled that of Phase 3 participants, although a larger proportion of families in this phase had received PPHC@Home for a longer period of time (Additional File 2).
Interviews lasted, on average, 81 min (range: 53 to 106 min). We revised several items because parents interpreted the meaning in a way that was not our intent, felt that the item did not apply to families in their situation, or felt the wording to be insensitive or inappropriate. For example, three parents felt that the item The care team has prepared me for what my child’s last weeks of life may be like was not applicable to their child’s rare disease since clinicians were not able to provide an accurate idea of what to expect at the end of life, and, thus, were not able to provide this type of preparation or guidance (code: limited applicability). Additionally, three parents did not like the word “prepare” because, as one parent noted, “I’m not sure that any [parent] would ever say that…I feel ready for that” (code: problems with wording). Based on these parents’ suggestions, we revised this item to The care team has talked with me about my child’s last weeks of life and what they may be like. Overall, we retained the original wording for five items, made minor revisions to 10 items (i.e., changes in one or two words), and made more substantial revisions to five items (i.e., changes in three or more words or otherwise substantial re-organization of the item).
While parents thought that the instrument was comprehensive, five parents suggested that we add an item assessing emotional support for siblings. As a result, we added the item The care team provides support for my other children’s feelings and emotions (Associated domain: Psychological and Emotional Aspects of Care: Sibling(s)). Additionally, while only one parent suggested an item about broad support for the parent caregiver, we agreed that this was a critical gap in the instrument and developed a new item, The care team has provided or directed me to resources that support my needs as my child’s caregiver (Related domains: Psychological and Emotional Aspects of Care: Parent(s), Social Aspects of Care: Parent(s); Caregiver Support at the End of Life). These new items were not cognitively tested with parents in this study. Ultimately, 22 items were retained as the final version of the Experiences of Palliative and Hospice Care for Children and Caregivers at Home (EXPERIENCE@Home) Measure (Table 5).
Employing a multi-method, multi-stakeholder approach for instrument development, we have developed the 22-item EXPERIENCE@Home Measure, which measures families’ experiences with PPHC@Home in the U.S. We began with broad palliative care guidelines and the peer-reviewed PPC and PPHC@Home literature and incorporated the perspectives of different stakeholders. To our knowledge, this is the first published study to have used a DCE approach for health care instrument development.
A strength of the EXPERIENCE@Home instrument is the multiple perspectives used to develop the items, including existing guidelines, peer-reviewed literature, and instruments; interdisciplinary PPHC professionals, researchers, and parent advocates; and bereaved parents and parents who are currently caring for their child at home. For example, we developed the item, The care team treats my child’s physical symptoms so that my child has as good a quality of life as possible, based on NCP Guidelines’ recommendation for assessing “physical symptoms and their impact on well-being, quality of life, and functional status.”  Our item not only evaluates whether or not a child’s physical symptoms were treated, as in existing instruments [21, 22, 24, 53, 57], but additionally, if treatment was perceived as effective – that is, if symptoms were treated in a way that the child could enjoy as good a quality of life as possible. This emphasis on quality of life was a priority for parents in our study, who rated this item as the most important (nearly twice as important as the next most important item) (Table 4). In cognitive interviews, parents emphasized the importance of treating symptoms so that their child could remain a part of family life and participate in social activities at school and in the community. Parents in other studies have also reported that PPHC@Home services were crucial for managing their children’s symptoms and supporting their children’s health-related quality of life in the home setting [11, 13, 24, 30].
Another strength is that our instrument also assesses home-specific aspects of care that were not represented in existing instruments. For example, the item, The care team helps adapt our home to better support my child’s current care needs, is based on recommendations from the Institute of Medicine  and the National Hospice and Palliative Care Organization . Interestingly, several parents in our study spoke not only of the importance of medical equipment and other home adaptations, such as a hospital bed or adaptive chairs, but also the importance of equipment that does not look too “medicalized” and that does not drastically alter the home environment. This is similar to a finding in a previous qualitative study of 12 families with children requiring mechanical ventilation in the home, where parents spoke of the importance of their homes looking “normal,” and that medical devices, equipment, and other adaptations (such as elevators or ceiling rails for facilitating mobilization) were camouflaged, hidden, or discrete so that they did not “dominate” the home environment . More work is needed to better understand families’ needs in this area.
Another item unique to the home setting is The care team helps me to feel confident in managing my child’s symptoms at home without needing to go to the hospital. We adapted this item from two existing studies on community-based PPC [11, 24]. Parents in our study spoke of the importance of having knowledge, supplies, medications, equipment, phone-based or in-person support from providers, and a plan in place when crisis situations arose at home. Parents’ confidence and perceived ability to manage their child’s illness and care needs have been observed to be an important facilitator of PPHC@Home . Comprehensive programs that provide families access to 24/7 on-call services, care coordination, and home visits by nursing and medical providers support the family’s ability to manage symptoms, particularly at the end of life [11, 29, 59]. These programs also help reduce unwanted hospital utilization and facilitate death in the family’s preferred location [11, 13, 21, 24, 60].
Finally, the item The nurses have the knowledge, skills, and experience to support my child’s palliative or hospice care at home was adapted from one existing instrument  and informed by NCP Guidelines . The availability of appropriately-trained nurses was a significant issue for many parents in our study. Several parents spoke of challenges in finding nurses who had both end-of-life and pediatric expertise. While home-based palliative and hospice nursing support is especially critical for helping caregivers troubleshoot technical problems and make decisions, and for providing respite care and overall emotional support to the family [59, 61], finding adequate palliative and hospice nursing support is often challenging [61,62,63,64]. Additionally, home care nurses play a significant role in the home-based care of many children with serious illnesses. Yet, finding adequate skilled and/or private duty nurses is often a significant challenge for families [64,65,66], which could lead to outcomes such as unintended re-hospitalizations [67, 68], increased hospital use [67, 69], and poor parental health and wellbeing [66, 70]. One parent in our study expressed frustration at being eligible for a certain number of skilled nursing hours for her child, but not being able to find nurses to fill those hours: “It’s just a sad scenario when you have the hours in place, and then you can’t find qualified people to cover them. That’s why you end up back in the hospital, right…sometimes you do settle because you need the extra hands because you’re just exhausted. Other times, you have to consider the situation and say, oh, we need to be back in the hospital because we’re just not going to be able to do it here.”
The cognitive interviews, of note, informed the re-addition of the item The care team provides support for my other children’s feelings and emotions. Several parents spoke of the importance of the team’s support for their other children, particularly as siblings may often be very involved in the day-to-day care of the ill sibling in the home. This proximity of siblings to the ill child’s care may be particularly important to PPHC provided in the home setting: one qualitative study found that siblings may fill many different roles at home, including playmate, companion, and helper, which included providing direct care such as feeding, toileting, and carrying their sibling from room to room . Although this item was initially removed in Phase 3, this could potentially be attributed to how the item was written and comprehended by participants. Another possible explanation for the lower rating may be attributed to the struggles parents face in balancing the care of the ill child with the child’s siblings [71,72,73]. Specifically, when making a choice between meeting their ill child’s and other children’s needs, parents may prioritize the ill child’s physical and emotional needs, which may be seen as requiring more immediate attention. In either case, meeting siblings’ needs is a documented gap in the PPC setting [71, 73], and we agreed with parents in Phase 4 that we should evaluate parents’ needs for sibling support by reincorporating this item into the instrument. Future work will need to evaluate if this item adequately addresses siblings’ most pressing needs in the home.
This instrument development project has some limitations. First, while we followed a rigorous process of item selection, prioritization, reduction, and cognitive interviewing, we may have missed or excluded important items or domains from our instrument. Our findings should not be interpreted to diminish critically-important aspects of PPHC@Home, as we know that high-quality PPC includes interdisciplinary care across the spectrum of care domains. Instead, our instrument represents the domains and associated items we have identified, through a multi-phased, multi-method approach, that are the most highly-prioritized for PPHC@Home by our sample of PPC professionals and parents. We will, however, continue to evaluate the content validity of the instrument in future work. Second, our PPC professional sample was relatively socio-demographically homogenous, although it does reflect the overall demographic profile of hospice and palliative physicians  and the nursing workforce more generally  in the U.S. Furthermore, professional participants represented several different professions, including parent advocates, nurses, physicians, social workers, chaplains, and expressive therapists. The sociodemographic profile of parent participants was also relatively homogenous, although not surprising given issues with gender [76, 77] and racial and ethnic minority  imbalance in PPC studies, as well as racial and ethnic disparities in access to home-based hospice care . We did, however, include parents of children with diverse diseases, and we also recruited a diverse sample with regard to illness trajectories by including parents whose children were currently receiving care, as well as bereaved parents. Additionally, both the professional and the parent samples came from a wide range of geographic regions, institutions, and care models. Nonetheless, it will be important to recruit a greater representation of fathers, racial and ethnic minorities, and persons from varying socioeconomic and educational backgrounds in future work. Third, because we recruited a portion of our parent participants from an online network, we were unable to assess our nonresponse rate and potential differences in how responders compared to non-responders. In our CHOP-based parents, however, reasons for non-participation typically related to being too busy or their child being too sick at the time of the study.
Through a phased, multi-method, multi-stakeholder instrument development process, we have developed the 22-item EXPERIENCE@Home Measure, which is the first known to specifically measure family-reported experiences with PPHC@Home in the U.S. The next steps in the assessment and refinement of this measure will include psychometric testing with a larger sample of parents of seriously-ill children receiving care at home, as well as an evaluation of the clinical utility of the instrument with PPHC providers for providing real-time, family-reported feedback to palliative care and hospice teams. While this further evaluation work is ongoing, we have developed a new instrument using rigorous methods that promises to be clinically useful for children with serious illness and their families. Our parent participants reiterated the importance of having a way to provide feedback about their care experiences at home to their providers. As one parent told us, “I think it would be a really effective tool… it just gives families like a, I don’t know, some agency over like what’s happening, and I think it’s a good thing.”
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Pediatric palliative care
Pediatric palliative and hospice care
Pediatric palliative and hospice care at home
National Consensus Project
Discrete choice experiment
Children’s Hospital of Philadelphia
Pediatric Advanced Care Team
Courageous Parents Network
Experiences of Palliative and Hospice Care for Children and Caregivers at Home Measure
Feudtner C, Friebert S, Jewell J. Pediatric palliative care and hospice care commitments, guidelines, and recommendations. Pediatr. 2013;132(5):966–72.
Feudtner C, Feinstein JA, Satchell M, Zhao H, Kang TI. Shifting place of death among children with complex chronic conditions in the United States, 1989–2003. JAMA. 2007;297(24):2725–32.
Feudtner C, Kang TI, Hexem KR, Friedrichsdorf SJ, Osenga K, Siden H, et al. Pediatric palliative care patients: A prospective multicenter cohort study. Pediatr. 2011;127(6):1094–101.
Burke RT, Alverson B. Impact of children with medically complex conditions. Pediatr. 2010;126(4):789–90.
Feudtner C, Silveira MJ, Christakis DA. Where do children with complex chronic conditions die? Patterns in Washington State, 1980–1998. Pediatr. 2002;109(4):656–60.
Friebert S, Williams C. NHPCO'S Facts and Figures: Pediatric Palliative and Hospice Care in America. Alexandria: NHPCO; 2015.
Feudtner C, Hays RM, Haynes G, Geyer JR, Neff JM, Koepsell TD. Deaths attributed to pediatric complex chronic conditions: National trends and implications for supportive care services. Pediatr. 2001;107(6):E99.
Nageswaran S, Radulovic A, Anania A. Transitions to and from the acute inpatient care setting for children with life-threatening illness. Pediatr Clin N Am. 2014;61(4):761–83.
Kaye E, Rubenstein J, Levine D, Baker JN, Dabbs D, Friebert S. Pediatric palliative care in the community. CA Cancer J Clin. 2015;65:315–33.
Boyden JY, Curley MAQ, Deatrick JA, Ersek M. Factors associated with the use of U.S. community-based palliative care for children with life-limiting or life-threatening illnesses and their families: An integrative review. J Pain Symptom Manag. 2018;55(1):117–31.
Bona K, Bates J, Wolfe J. Massachusetts' Pediatric Palliative Care Network: Successful implementation of a novel state-funded pediatric palliative care program. J Palliat Med. 2011;14(11):1217–23.
Knapp CA, Madden VL, Curtis CM, Sloyer PJ, Huang IC, Thompson LA, et al. Partners in Care: Together for Kids: Florida's model of pediatric palliative care. J Palliat Med. 2008;11(9):1212–20.
Friedrichsdorf SJ, Postier A, Dreyfus J, Osenga K, Sencer S, Wolfe J. Improved quality of life at end of life related to home-based palliative care in children with cancer. J Palliat Med. 2015;18(2):143–50.
Thienprayoon R, Grossoehme D, Humphrey L, Pestian T, Frimpong-Manso M, Malcolm H, et al. "There's Just No Way to Help, and They Did." Parents name Compassionate Care as a new domain of quality in pediatric home-based hospice and palliative care. J Palliat Med. 2020;23(6):767–76.
Lindley LC, Lyon ME. A profile of children with complex chronic conditions at end of life among Medicaid beneficiaries: Implications for health care reform. J Palliat Med. 2013;16(11):1388–93.
Carroll JM, Santucci G, Kang TI, Feudtner C. Partners in Pediatric Palliative Care: A program to enhance collaboration between hospital and community palliative care services. Amer J Hosp Palliat Med. 2007;24(3):191–5.
Field MJ, Behrman RE. When Children Die: Improving Palliative and End-of-Life care for Children and their Families. Washington, DC: The National Academies Press; 2003. Available from: https://www.nap.edu/catalog/10390/when-children-die-improving-palliative-and-end-of-life-care. Accessed 27 July 2020.
Conway PH, Mostashari F, Clancy C. The future of quality measurement for improvement and accountability. JAMA. 2013;309(21):2215–6.
Snyder CF, Aaronson NK, Choucair AK, Elliott TE, Greenhalgh J, Halyard MY, et al. Implementing patient-reported outcomes assessment in clinical practice: A review of the options and considerations. Qual Life Res. 2012;21(8):1305–14.
Widger K, Brennenstuhl S, Duc J, Tourangeau A, Rapoport A. Factor structure of the Quality of Children’s Palliative Care Instrument (QCPCI) when completed by parents of children with cancer. BMC Palliat Care. 2019;18(1):23.
Vollenbroich R, Duroux A, Grasser M, Brandstatter M, Borasio GD, Fuhrer M. Effectiveness of a pediatric palliative home care team as experienced by parents and health care professionals. J Palliat Med. 2012;15(3):294–300.
Zimmermann K, Cignacco E, Eskola K, Engberg S, Ramelet A-S, Von der Weid N, et al. Development and initial validation of the Parental PELICAN Questionnaire (PaPEQu): An instrument to assess parental experiences and needs during their child's end-of-life care. J Adv Nurs. 2015;71(12):3006–17.
Linton JM, Feudtner C. What accounts for differences or disparities in pediatric palliative and end-of-life care? A systematic review focusing on possible multilevel mechanisms. Pediatr. 2008;122:574–82.
Goldhagen J, Fafard M, Komatz K, Eason T, Livingood WC. Community-based pediatric palliative care for health related quality of life, hospital utilization and costs lessons learned from a pilot study. BMC Palliat Care. 2016;15:73.
National Consensus Project for Quality Palliative Care. Clinical Practice Guidelines for Quality Palliative Care: National Coalition for Hospice and Palliative Care. Richmond: National Coalition For Hospice & Palliative Care; 2018. https://www.nationalcoalitionhpc.org/ncp/. Accessed 5 June 2020.
National Hospice and Palliative Care Organization (NHPCO). Standards of practice for pediatric palliative care. 2019. https://www.nhpco.org/wp-content/uploads/2019/07/Pediatric_Standards.pdf. Accessed 12 June 2020.
Thienprayoon R, Mark MSJ, Grossoehme D. Provider-prioritized domains of quality in pediatric home-based hospice and palliative care: A study of the Ohio Pediatric Palliative Care and End-of-Life Network. J Palliat Med. 2018;31(3):290–6.
Gans D, Kominski GF, Roby DH, Diamant AL, Chen X, Lin W, et al. Better outcomes, lower costs: Palliative care program reduces stress, costs of care for children with life-threatening conditions. Los Angeles: UCLA Center for Health Policy Research; 2012. http://healthpolicy.ucla.edu/publications/search/pages/detail.aspx?PubID=1087. Accessed 6 Jan 2021.
Thienprayoon R, Marks E, Funes M, Martinez-Puente LM, Winick N, Lee SC. Perceptions of the pediatric hospice experience among English- and Spanish-speaking families. J Palliat Med. 2016;19(1):30–41.
Hays RM, Valentine J, Haynes G, Geyer JR, Villareale N, McKinstry B, et al. The Seattle Pediatric Palliative Care Project: Effects on family satisfaction and health-related quality of life. J Palliat Med. 2006;9(3):716–28.
Anhang Price R, Stucky B, Parast L, Elliott MN, Haas A, Bradley M, et al. Development of valid and reliable measures of patient and family experiences of hospice care for public reporting. J Palliat Med. 2018;21(7):924–32.
Kutney-Lee A, Carpenter J, Smith D, Thorpe J, Tudose A, Ersek M. Case-mix adjustment of the Bereaved Family Survey. Amer J Hosp Palliat Med. 2018;35(7):1015–22.
Gomes B, de Brito M, Sarmento VP, Yi D, Soares D, Fernandes J, et al. Valuing attributes of home palliative care with service users: A pilot discrete choice experiment. J Pain Symptom Manag. 2017;54(6):973–85.
Huynh E, Coast J, Rose J, Kinghorn P, Flynn T. Values for the ICECAP-Supportive Care Measure (ICECAP-SCM) for use in economic evaluation at end of life. Soc Sci Med. 2017;189:114–28.
Mangham LJ, Hanson K, McPake B. How to do (or not to do) … Designing a discrete choice experiment for application in a low-income country. Health Policy Plan. 2009;24(2):151–8.
Ryan M, Gerard K, Amaya-Amaya M. In: Bateman IJ, editor. Using Discrete Choice Experiments to Value Health and Health Care. The Netherlands: Springer; 2008.
Feudtner C, Walter JK, Faerber JA, Hill DL, Carroll KW, Mollen CJ, et al. Good-parent beliefs of parents of seriously ill children. JAMA Pediatr. 2015;169(1):39–47.
October TW, Fisher K, Feudtner C, Hinds PS. The parent perspective: "being a good parent" when making critical decisions in the PICU. Pediatr Crit Care Med. 2014;15(4):291–8.
Cohen SH. Maximum difference scaling: Improved measures of importance and preference for segmentation. Sequim: Sawtooth Software; 2003. https://www.sawtoothsoftware.com/support/technical-papers/maxdiff-best-worst-scaling/maximum-difference-scaling-improved-measures-of-importance-and-preference-for-segmentation-2003. Accessed 27 July 2020.
Louviere JJ, Flynn TN, Carson RT. Discrete choice experiments are not conjoint analysis. J Choice Model. 2010;3(3):57–72.
Malcolm C, Knighting K, Forbat L, Kearney N. Prioritisation of future research topics for children's hospice care by its key stakeholders: A Delphi study. Palliat Med. 2009;23(5):398–405.
Chrazan K, Orme B. Applied MaxDiff: a practitioner’s guide to best-worst scaling. Provo: Sawtooth Software, Inc.; 2019.
Sawtooth Software. Bandit MaxDiff: When to use it and why it can be a better choice than standard MaxDiff. 2018. https://www.sawtoothsoftware.com/support/technical-papers/maxdiff-best-worst-scaling/175-support/technical-papers/maxdiff-best-worst-scaling/1943-bandit-maxdiff-when-to-use-it-and-why-it-can-be-a-better-choice-than-standard-maxdiff. Accessed 30 June 2020.
EWd B-G, Donkers B, Jonker MF, Stolk EA. Sample size requirements for discrete-choice experiments in healthcare: A practical guide. Patient. 2015;8(5):373–84.
Lancsar E, Louviere J. Conducting discrete choice experiments to inform healthcare decision making. Pharmacoeconomics. 2008;26(8):661–77.
Flynn TN, Louviere JJ, Peters TJ, Coast J. Best-worst scaling: What it can do for health care research and how to do it. J Health Econ. 2007;26(1):171–89.
Sawtooth Software. Aggregate score estimation via logit analysis. Orem: Sawtooth Software; 2018. https://www.sawtoothsoftware.com/help/lighthouse-studio/manual/maxdiff_aggregate_logit_analysis.html. Accessed 30 June 2020.
Bentley B, O'Connor M. Conducting research interviews with bereaved family carers: When do we ask? J Palliat Med. 2015;18(3):241–5.
Hynson JL, Aroni R, Bauld C, Sawyer S. Research with bereaved parents: A question of how not why. Palliat Med. 2006;20:805–11.
Casarett DJ, Crowley R, Hirschman KB. Surveys to assess satisfaction with end-of-life care: Does timing matter? J Pain Symptom Manag. 2003;25(2):128–32.
Addington-Hall J, McPherson C. After-death interviews with surrogates/bereaved family members: Some issues of validity. J Pain Symptom Manag. 2001;22(3):784–90.
Boyden JY, Ersek M, Deatrick JA, Widger K, LaRagione G, Lord B, Feudtner C. What do parents value regarding home-based pediatric palliative and hospice care? J Pain Symptom Manage. 2021;61(1):12–23.
Widger K, Tourangeau AE, Steele R, Streiner DL. Initial development and psychometric testing of an instrument to measure the quality of children's end-of-life care. BMC Palliat Care. 2015;14(1):1.
CAHPS. Hospice Survey: Frequently asked questions. Baltimore: Centers for Medicare & Medicaid Services; 2019. https://hospicecahpssurvey.org/en/hospice-specific-faqs2/#Q8. Accessed 30 June 2020.
Charlebois J, Cyr C. Quality indicators for paediatric palliative care. Paediatr Child Health. 2015;20(3):145–7.
Knafl K, Deatrick J, Gallo A, Holcombe G, Bakitas M, Dixon J, et al. The analysis and interpretation of cognitive interviews for instrument development. Res Nurs Health. 2007;30(2):224–34.
Donnelly JP, Downing K, Cloen J, Fragen P, Gupton AW, Misasi J, et al. Development and assessment of a measure of parent and child needs in pediatric palliative care. J Pain Symptom Manag. 2017;55(4):1077–84.
Carnevale FA, Alexander E, Davis M, Rennick J, Troini R. Daily living with distress and enrichment: The moral experience of families with ventilator-assisted children at home. Pediatr. 2006;117(1):e48.
Davies B, Gudmundsdottir M, Worden B, Orloff S, Sumner L, Brenner P. "Living in the dragon's shadow" fathers' experiences of a child's life-limiting illness. Death Stud. 2004;28(2):111–35.
Postier A, Chrastek J, Nugent S, Osenga K, Friedrichsdorf SJ. Exposure to home-based pediatric palliative and hospice care and its impact on hospital and emergency care charges at a single institution. J Palliat Med. 2014;17(2):183–8.
Bee PE, Barnes P, Luker KA. A systematic review of informal caregivers’ needs in providing home-based end-of-life care to people with cancer. J Clin Nurs. 2009;18(10):1379–93.
Rehm RS, Bradley JF. Normalization in families raising a child who is medically fragile/technology dependent and developmentally delayed. Qual Health Res. 2005;15(6):807–20.
Varela AMS, Deal AM, Hanson LC, Blatt J, Gold S, Dellon EP. Barriers to hospice for children as perceived by hospice organizations in North Carolina. Amer J Hospice Palliat Care. 2012;29(3):171–6.
Kaye EC, Gattas M, Kiefer A, Reynolds J, Zalud K, Li C, et al. Provision of palliative and hospice care to children in the community: A population study of hospice nurses. J Pain Symptom Manag. 2019;57(2):241–50.
Weaver MS, Wichman B, Bace S, Schroeder D, Vail C, Wichman C, et al. Measuring the impact of the home health nursing shortage on family caregivers of children receiving palliative care. J Hosp Palliat Nurs. 2018;20(3):260–5.
Meltzer LJ, Boroughs DS, Downes JJ. The relationship between home nursing coverage, sleep, and daytime functioning in parents of ventilator-assisted children. J Pediatr Nurs. 2010;25(4):250–7.
Gay JC, Thurm CW, Hall M, Fassino MJ, Fowler L, Palusci JV, et al. Home health nursing care and hospital use for medically complex children. Pediatr. 2016;138(5):e20160530.
Sobotka SA, Lynch E, Peek ME, Graham RJ. Readmission drivers for children with medical complexity: Home nursing shortages cause health crises. Pediatr Pulmonol. 2020;55(6):1474–80.
Boss RD, Williams EP, Henderson CM, Seltzer RR, Shapiro MC, Hahn E, et al. Pediatric chronic critical illness: Reducing excess hospitalizations. Hosp Pediatr. 2017;7(8):460–70.
Caicedo C. Health and functioning of families of children with special health care needs cared for in home care, long-term care, and medical day care settings. J Dev Behav Pediatr. 2015;36:352–61.
Eaton Russell C, Widger K, Beaune L, Neville A, Cadell S, Steele R, et al. Siblings' voices: A prospective investigation of experiences with a dying child. Death Stud. 2018;42(3):184–94.
Mooney-Doyle K, Deatrick JA. Parenting in the face of childhood life-threatening conditions: The ordinary in the context of the extraordinary. Palliat Support Care. 2016;14(3):187–98.
Verberne LM, Kars MC, Schouten-van Meeteren AY, Bosman DK, Colenbrander DA, Grootenhuis MA, et al. Aims and tasks in parental caregiving for children receiving palliative care at home: a qualitative study. Eur J Pediatr. 2017;176(3):343–54.
Salsberg E, Mehfoud N, Quigley L, Lupu D. A profile of active hospice and palliative medicine physicians, 2016. Washington: American Academy of Hospice and Palliative Medicine & Health Workforce Institute, The George Washington University; 2017. http://aahpm.org/uploads/Profile_of_Active_HPM_Physicians_September_2017.pdf. Accessed 30 June 2020.
Nursing workforce projections by ethnicity and race 2014–2030. HRSA Health Workforce. 2017. https://bhw.hrsa.gov/sites/default/files/bhw/health-workforce-analysis/research/projections/hrsa-bhw-rn-lpn-factsheet-12-17.pdf. Accessed 30 June 2020.
Hinds PS, Burghen EA, Pritchard M. Conducting end-of-life studies in pediatric oncology. West J Nurs Res. 2007;29(4):448–65.
Macdonald ME, Chilibeck G, Affleck W, Cadell S. Gender imbalance in pediatric palliative care research samples. Palliat Med. 2010;24(4):435–44.
Knapp CA, Madden VL, Curtis C, Sloyer PJ, Shenkman EA. Assessing non-response bias in pediatric palliative care research. Palliat Med. 2010;24(3):340–7.
Cohen LL. Racial/ethnic disparities in hospice care: A systematic review. J Palliat Med. 2008;11(5):763–8.
Widger KA, Wilkins K. What are the key components of quality perinatal and pediatric end-of-life care? A literature review. J Palliat Care. 2004;20(2):105–12.
Hinds PS, Menard JC, Jacobs SS. The child's voice in pediatric palliative and end-of-life care. Prog Palliat Care. 2012;20(6):337–42.
The authors would like to acknowledge the Children’s Hospital of Philadelphia’s Justin Michael Ingerman Center for Palliative Care and the Courageous Parents Network, who supported the design and data collection phases of this study. In particular, we would like to thank Ms. Karen Crew and Ms. Dana Dombrowski for their guidance and effort on this project. We would also like to thank Ms. Solim Lee, Ms. Heather Carlino, and Dr. Patricia Pawlow from the University of Pennsylvania School of Nursing for their assistance with piloting the cognitive interviews. We would like to acknowledge all of the clinicians, parent advocates, and researchers who shared their time and expertise with us. And finally, we would like to acknowledge the parents who so generously gave their time and energy to participate in this project. We are deeply grateful for their willingness to share their perspectives with us and to help us work toward advancing the quality of care provided in the home setting for future children and families.
Research reported in this publication was supported by the National Institute of Nursing Research of the National Institutes of Health under Award Number F31NR017554. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. Additional research funding was provided by the University of Pennsylvania School of Nursing Office of Nursing Research Student Research Grant, the Independence Blue Cross Foundation Nurses for Tomorrow Scholars Program, and the Sawtooth Software Academic Grant. Funders were not involved in the design of the study; in data collection, analysis, or interpretation; or in writing the manuscript.
Ethics approval and consent to participate
The Children’s Hospital of Philadelphia’s (CHOP) Institutional Review Board approved this study. All partipcants provided their electronic informed consent to participate.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Boyden, J.Y., Feudtner, C., Deatrick, J.A. et al. Developing a family-reported measure of experiences with home-based pediatric palliative and hospice care: a multi-method, multi-stakeholder approach. BMC Palliat Care 20, 17 (2021). https://doi.org/10.1186/s12904-020-00703-0