Skip to main content

Development and usability testing of Understanding Stroke, a tailored life-sustaining treatment decision support tool for stroke surrogate decision makers

Abstract

Background

Surrogate decision makers of stroke patients are often unprepared to make critical decisions on life-sustaining treatments. We describe the development process and key features for the Understanding Stroke web-based decision support tool.

Methods

We used multiple strategies to develop a patient-centered, tailored decision aid. We began by forming a Patient and Family Advisory Council to provide continuous input to our multidisciplinary team on the development of the tool. Additionally, focus groups consisting of nurses, therapists, social workers, physicians, stroke survivors, and family members reviewed key elements of the tool, including prognostic information, graphical displays, and values clarification exercise. To design the values clarification exercise, we asked focus groups to provide feedback on a list of important activities of daily living. An ordinal prognostic model was developed for ischemic stroke and intracerebral hemorrhage using data taken from the Virtual International Stroke Trials Archive Plus, and incorporated into the tool.

Results

Focus group participants recommended making numeric prognostic information optional due to possible emotional distress. Pie charts were generally favored by participants for graphical presentation of prognostic information, though a horizontal stacked bar chart was also added due to its prevalence in stroke literature. Plain language descriptions of the modified Rankin Scale were created to accompany the prognostic information. A values clarification exercise was developed consisting of a list of 13 situations that may make an individual consider comfort measures only. The final version of the web based tool (which can be viewed on tablets) included the following sections: general introduction to stroke, outcomes (prognostic information and recovery), in-hospital and life-sustaining treatments, decision making and values clarification, post-hospital care, tips for talking to the health care team, and a summary report. Preliminary usability testing received generally favorable feedback.

Conclusion

We developed Understanding Stroke, a tailored decision support tool for surrogate decision makers of stroke patients. The tool was well received and will be formally pilot tested in a group of stroke surrogate decision makers.

Trial registration

ClinicalTrials.gov (NCT03427645).

Peer Review reports

Background

Patients hospitalized with serious acute illness face critical decisions about their medical care and use of life sustaining treatments. In neurologic illness such as stroke, patient decisional capacity is commonly impaired and decisions regarding interventions such as resuscitation, ventilation, or artificial nutrition are made by a surrogate decision maker who is typically a family member or trusted loved one. However, many surrogates are unprepared to make these decisions for their loved ones [1,2,3]. They may have difficulty determining what the patient would want, and as a result, may suffer long-term adverse psychological outcomes [3,4,5,6].

Decision support tools have been shown to improve the quality of decision making and reduce decisional conflict in multiple clinical settings [7]. However, only a limited number of tools have been developed to support decision-making on life sustaining treatment during an acute hospitalization [6, 8,9,10,11,12,13], and none have been specifically developed for stroke decision making. To address these gaps, we developed a web-based decision support tool, called Understanding Stroke: A Guide for Family Decision Makers, designed to help surrogate decision makers set the overall goals of treatment for a loved one hospitalized with an acute stroke. Here, we describe the development process, key features, and initial usability testing for this tool.

Methods

Patient and family advisory council

A Patient and Family Advisory Council (PFAC) was formed to provide continuous input on the development of the tool. The Council included stroke survivors and family members of survivors recruited from the patient population of the study center. The Council met at the beginning of the study in December 2017 to share their experiences with stroke with the study team, and also give feedback on specific proposed elements of the decision support tool. These tool elements included graphical displays of prognostic information (pie charts, bar charts, and pictographs/icon arrays); simplified descriptions of a standardized stroke outcome scale (modified Rankin scale) [14,15,16,17]; and a list of valued life activities to include in a values clarification exercise [18]. Subsequently, members of the PFAC provided ongoing feedback to the study team on draft versions of the materials and participated in up to two usability testing sessions during the final stages of development.

Stakeholder focus groups

Focus groups of key stakeholders were recruited between December 2017 and April 2018. Groups were segmented intentionally to encourage candid responses. The four groups were as follows: nurses, therapists, and social workers with expertise in stroke or palliative care; physicians with expertise in stroke; stroke survivors and family members; and family members without stroke patients present. Provider participants were selected through a convenience sample from two hospital systems. Stroke survivors and their families, as well as bereaved family members, were recruited by contacting subjects from past research studies who agreed to be contacted for future research, as well as by sending out invitations to the Michigan Medicine Patient and Family Centered Care (PFCC) Program. Each focus group lasted approximately 2 h, and was primarily facilitated by author CA, a cardiovascular nurse researcher with extensive experience in conducting focus group sessions, and assisted by authors DZ, the principal investigator and a stroke physician, and WN, an expert in human computer interaction. Providers were asked about their experiences communicating stroke prognoses with patients and families, whether they use numbers or percentages and why. Stroke survivors and family members were asked about their experiences talking with the doctors and nurses early in the hospitalization about prognosis. Specifically, they were asked who discussed this with them, how the information was communicated and whether it was helpful, and what they think patients and families should have been told early on in the hospitalization. All groups provided feedback on draft elements on the tool, including graphical displays, descriptions of prognostic information, the language used to describe stroke outcome categories from the modified Rankin scale, and the list of valued life activities for the values clarification exercise. Focus group conversations were audio recorded and key themes were summarized by the study team. Demographic data for the focus group participants are listed in Additional file 1.

Content development

After the focus groups were complete, the study team began developing the tool content. A content map was developed by a multi-disciplinary team including experts in vascular neurology, cardiovascular nursing, psychology, human computer interaction, and tailored behavioral change and health education interventions. The tool content was divided into 6 main sections – About Stroke (general introduction), Stroke Outcomes (levels of disability and prognostic calculator), In the Hospital (common treatments), Making Decisions (goals of treatment and values clarification), After the Hospital (rehabilitation options), and Asking Questions. Developing the content map was an iterative process where the organization of topics was rearranged to achieve the best flow, with the final content map shown in Fig. 1. Introductory descriptions of ischemic stroke and intracerebral hemorrhage were adapted from existing materials [19, 20]. A behavioral scientist with expertise in developing tailored health communication interventions revised the content to fit the goals of the decision support tool and ensured that it was written in plain language. Illustrations demonstrating ischemic stroke and intracerebral hemorrhage were also developed. The unique elements of the tool (e.g. prognostic calculator and values clarification), were written in more detail than the informational components, such as what rehabilitation options are available after leaving the hospital. Key information was then summarized into a printer-friendly summary report (see Additional file 2) that the surrogate decision maker could use to facilitate their communication with the treating health care team.

Fig. 1
figure1

Content map. This shows the order in which each topic is presented in the Understanding Stroke tool. The user is encouraged to follow this sequence, but may choose to skip to any section using the navigation bar on the top of the page

Prognostic models and calculator

Ordinal prognostic models for Understanding Stroke were developed separately for ischemic stroke (IS) and intracerebral hemorrhage (ICH). We chose to develop a novel model rather than use an existing model as most existing models predict a binary outcome rather than a full ordinal range of outcomes after stroke [21, 22]. Detailed statistical methods for model development will be reported separately [23]. Briefly, data for the model development was taken from the Virtual International Stroke Trials Archive Plus (VISTA-Plus) [24] which has 90-day mRS data for 9904 IS patients and 890 ICH patients. The mRS was selected as the outcome based on its broad availability in stroke studies and the large number of cases with data available in VISTA-Plus. Common predictor variables for both IS and ICH include age, NIH Stroke Scale (NIHSS), history of atrial fibrillation, diabetes, and prior stroke. For ischemic cases, other predictors include the NIHSS Level of Consciousness score (item 1a from the NIHSS) and whether the patient received intravenous tissue plasminogen activator (IV tPA), while the ICH model included sex as a predictor variable. When a surrogate is enrolled, the study team manually entered predictor variables into the website’s study team dashboard, which then calculated the results and fed the information to the Understanding Stroke website. As the direct display of prognostic calculator information to surrogates was a novel aspect of this tool, it was designed with an option to disable the display of calculator information at the discretion of the investigators. This option was created to guard against the possibility of concerns about model accuracy for individual patients with unusual features at presentation, or in the event of negative feedback from early enrollees.

Values clarification exercise

Medical decision making experts generally recommend the inclusion of values clarification methods in decision support tools to help elicit values relevant to the decision [18, 25]. We conceptualized the values clarification exercise in this setting as helping the surrogate to think about which abilities are essential for the patient’s quality of life.

To begin developing the values clarification exercise, a preliminary list of important activities of daily living and functional abilities was created by adapting items from other tools [26, 27] and by adding individual items suggested by the focus group participants. Duplicative or similar items were merged, and the study team added a few items common in post-stroke patients (e.g., “Could not move one side of their body”) to make a comprehensive list. To assess the relative importance of each item and help to assure readability, the comprehensive list was made into a card sorting exercise. A convenience sample of volunteer participants was recruited from outpatient stroke and cardiovascular clinic waiting areas. Participants were shown, in random order, a list of the 14 items that may be important for people to think about when making medical decisions for a family member. The participant was then asked to rank the items on a board in order from most important to least important and add any additional items they felt were missing from the pool. Any item that did not play a role in decision making was asked to be left off the board. Therefore, the number of items ranked varied for each participant. We recorded their responses and scored the items according to their rankings.

Usability testing

Finally, two rounds of usability testing were completed with volunteers from the PFAC, focus group participants, and health care providers. In these sessions, participants were first asked to locate specific pieces of information or complete certain tasks within the tool. Then they were asked a few questions from a modified Systems Usability Scale (SUS) [28] regarding the level of difficulty and complexity of using the tool. Lastly, they were asked a series of open-ended questions about what they liked the most, what could be improved, and whether they felt anything was missing from the website. Participants in the first round of usability testing also participated in the card sorting exercise mentioned above.

Results

A total of four focus groups were held that included 8 physicians, 1 nurse, 5 occupational or physical therapists, 1 social worker, 5 stroke survivors, and 6 family members. When asked about the presentation of prognostic calculator results, some providers, patients, and family members expressed that some people will like numbers, while others may find it distressing and unhelpful. It was suggested that a preface would be needed to warn surrogates about the potential emotional distress it may evoke and also to offer the option to not view the personalized numeric prognosis. Some stroke family members expressed the desire for the prognostic model to show outcomes beyond 3 months. However, due to limitations of the available source data, we were unable to accommodate this request. To clarify to the user that continued improvement is possible beyond 3 months, the following sentence was added – “While people can continue to improve for a year or more after a stroke, doctors have found that most recovery happens in the first 3 to 6 months.”

When asked about the best graphical format for presentation, pie charts were overwhelmingly favored by patients, surrogates, and providers alike. Other options with positive responses included the vertical bar chart, icon array [29], and the horizontal stacked bar chart (primarily preferred by providers due to its common presence in stroke literature). Although icon arrays are a commonly recommended format to present numeric information [30, 31], most participants did not favor icon arrays, in part due the complexity of displaying multiple outcome categories. The study team ultimately decided to display both a pie chart and a horizontal bar chart, with the option to toggle between the two options depending on surrogate preference.

A plain language description of each level of the modified Rankin Scale was created to accompany the prognostic information to help with interpretation of the prognostic model. Due to the study targeting a moderate to severe stroke population, and to minimize the number of displayed categories, mRS scores of 0–2 were combined to become a single category of “mild disability or better”. The other scores were maintained as distinct categories – “moderate disability”, “moderately severe disability”, and “severe disability”, for mRS 3, 4, and 5, respectively. Examples of residual symptoms were listed to help family members understand the range of possible outcomes. The descriptions also included examples on the types of assistance they may need, e.g., not able to live alone, need help with daily activities, etc. The full description of text used for the modified Rankin scale is shown in Table 1.

Table 1 Plain language description of the modified Rankin Scale

Given the multitude of life-sustaining treatment decisions that a stroke surrogate decision maker may face (e.g. intubation, resuscitation, feeding tube), Understanding Stroke was designed to frame the decision as setting the overall goals of treatment rather than on any individual treatment or procedure. The overall goals of treatment were adapted from prior work and includes Life-Prolonging Treatment, Basic Treatment, and Comfort Measures Only [32]. Information about the three possible goals of treatment are summarized for surrogates as shown in Table 2. This section on making treatment decisions also includes education on what it means to be a surrogate decision maker and the importance of focusing on what their loved one would want [33].

Table 2 Summary of goals of treatment

A total of 24 participants were recruited (22 patients or family members, and 2 non-physician members of the stroke team) for the card sorting exercise to assist in developing the values clarification component. One item regarding the ability to drive was ranked as the least important by participants and was eliminated. No new items were added by the participants. The final list consists of 13 items shown in Table 3, which was made into a checklist for the surrogate to check off. The stem of the exercise was “My loved one might consider stopping treatment to extend life (and choose comfort measures only) if, for a few months or more, they” An additional option of “None of the above” was added for surrogates who think their family member would want to extend life despite all of these circumstances.

Table 3 Values clarification exercise

Two rounds of usability testing were conducted. The first was done 6 months prior to making the tool available to participants to allow time to make changes, and the second was 1 month prior for a final check. The combined participants across both rounds included 2 stroke survivors, 5 family members, and 2 stroke providers. In the task directive section, most people were able to find a specific section when asked. For anything that was more difficult to find, interface and navigation enhancements were made to the tool to improve the visibility of these items to the user. Results from the modified SUS show that most people felt the website was easy to navigate and interact with. A small number of participants felt they had to learn a lot of things before they could start using the website in the first round, or that using the tool was at a moderate level of difficulty rather than easy. Participants liked the layout, the information presented, the presentation of the prognostic information, and the values clarification exercise. Some overall suggestions included making navigation easier by repositioning certain buttons and adding a website content outline and additional resource links to the main page. An overview of the final version of the tool content and graphics is shown in Additional file 2.

Discussion

We described the development of Understanding Stroke: A Guide for Family Decision Makers, a web-based decision support tool for surrogate decision makers of stroke patients. The tool was developed through a rigorous process that involved a PFAC, four focus groups, a multidisciplinary study team, card sorting by volunteer patients and family members, and two rounds of usability testing. The tool received positive feedback during usability testing, and most individuals found the content helpful and the website easy to use. The text was rated as an 8th grade reading level in the Flesch-Kincaid readability test.

The tool features tailored content that takes into account the patient’s stroke type and medical history, and displays information and prognostic calculator results accordingly. To be mindful of family members’ preferences for information, the tool also offers the option to not see the prognosis. Goals of treatment are explained in detail, and a values clarification exercise is available to help surrogate decision makers determine what the patient would want in accordance with their values. Lastly, the tool summarizes key information from the interactive components and compiles a report which can be printed out by the family member.

Previous decision support tools addressing decisions on life-sustaining treatments have primarily focused on advanced care planning [12, 27, 34, 35] with relatively few tools designed for use during an acute inpatient hospitalization. Other tools designed for use during an acute hospitalization have been developed for traumatic brain injury [36] and prolonged mechanical ventilation [9, 13, 37]. A recent pilot testing of a decision aid for prolonged mechanical ventilation suggested some improved outcomes, including lower physician-surrogate discordance for expected patient survival, greater comprehension, and improved quality of communication post-intervention [9]. However, a larger randomized trial of the web-based version did not confirm the benefits other than observing a small reduction in decision conflict in the intervention group [37]. Our tool shares many features with this web-based tool, including the utilization of a prognostic model and visual display of results, a values clarification exercise that focuses on goals of treatment decisions, additional questions for the care team, and a summary report that compiles key information. However, the differences in disease context, intended timeframe of use, and our different design of the values clarification exercise suggests a separate study of Understanding Stroke is still warranted. In a systematic review done by Witteman et al., it was noted that there is a wide variety of design features in current values clarification tools, and more work is needed to evaluate their effects [38, 39].

Understanding Stroke is currently being pilot tested in a non-randomized trial of 50 surrogate decision makers, with 25 each in a historical control group and intervention group. Enrollment of the control group began in February, 2018, concurrent with the development of Understanding Stroke. Participants completed a baseline survey and a 1-month follow-up survey. For those in the intervention group, the website is shown on a tablet computer immediately following the baseline survey, followed by a post-intervention survey with tool-specific questions. Registration of this trial can be found on ClinicalTrials.gov (NCT03427645) [40].

There are several limitations to the current version of Understanding Stroke worth noting. One is that the tool focuses primarily on informational needs and does not address the emotional needs of surrogate decision makers. Other studies have shown that surrogates of seriously ill individuals have considerable need for emotional support [37, 41,42,43]. However, this tool is in the early development stage. A future version could incorporate more comprehensive interventions that include both information and emotional support to family members. Secondly, the modified Rankin Scale was selected as the outcome because of its broad availability and use in stroke patients. There were concerns among the participants that the mRS would not convey the different types of disability, such as cognitive or speech impairment, and that different readers could interpret the information differently. Future work should address stroke prognostic models with a broader range of outcomes that may be more meaningful to patients and families. The tool also lacks a physician-facing component or direct integration into clinicians’ workflow. This design was by choice, in part to simplify the development and implementation of the initial version of the tool. Here again, a future version could be adapted to include a physician facing component or more direct integration into the clinical workflow. Lastly, although the tool was developed by following user-centered design principles, potential future enhancement could be realized through an experience-based co-design process that more actively involves participants in re-imagining the current decision aid with the support of a trained facilitator [44]. Such a redesign should take into consideration the overall outcomes of the current tool and seek to improve that experience.

Conclusion

In summary, we developed Understanding Stroke, a tailored decision support tool for surrogate decision makers of stroke patients. The tool was well received during usability testing and will be pilot tested for preliminary assessment of acceptability, as well as its effect on surrogates’ understanding of prognosis and decisional self-efficacy in the clinical setting.

Availability of data and materials

Not applicable.

Abbreviations

ICH:

Intracerebral hemorrhage

IS:

Ischemic stroke

IV tPA:

Intravenous tissue plasminogen activator

NIHSS:

National Institutes of Health Stroke Scale

PFAC:

Patient and Family Advisory Council

PFCC:

Patient and Family Centered Care

SUS:

Systems Usability Scale

VISTA-Plus:

Virtual International Stroke Trials Archive Plus

References

  1. 1.

    Fagerlin A, Ditto PH, Danks JH, Houts RM, Smucker WD. Projection in surrogate decisions about life-sustaining medical treatments. Health Psychol. 2001;20(3):166–75.

    CAS  PubMed  Article  Google Scholar 

  2. 2.

    Fagerlin A, Schneider CE. Enough. The failure of the living will. Hast Cent Rep. 2004;34(2):30–42.

    Article  Google Scholar 

  3. 3.

    Majesko A, Hong SY, Weissfeld L, White DB. Identifying family members who may struggle in the role of surrogate decision maker. Crit Care Med. 2012;40(8):2281–6.

    PubMed  PubMed Central  Article  Google Scholar 

  4. 4.

    Anderson WG, Arnold RM, Angus DC, Bryce CL. Posttraumatic stress and complicated grief in family members of patients in the intensive care unit. J Gen Intern Med. 2008;23(11):1871–6.

    PubMed  PubMed Central  Article  Google Scholar 

  5. 5.

    Azoulay E, Pochard F, Kentish-Barnes N, Chevret S, Aboab J, Adrie C, et al. Risk of post-traumatic stress symptoms in family members of intensive care unit patients. Am J Respir Crit Care Med. 2005;171(9):987–94.

    PubMed  Article  Google Scholar 

  6. 6.

    Lautrette A, Darmon M, Megarbane B, Joly LM, Chevret S, Adrie C, et al. A communication strategy and brochure for relatives of patients dying in the ICU. N Engl J Med. 2007;356(5):469–78.

    CAS  PubMed  Article  Google Scholar 

  7. 7.

    Stacey D, Legare F, Col NF, Bennett CL, Barry MJ, Eden KB, et al. Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2014;1:CD001431.

    Google Scholar 

  8. 8.

    Cai X, Robinson J, Muehlschlegel S, White DB, Holloway RG, Sheth KN, et al. Patient preferences and surrogate decision making in neuroscience intensive care units. Neurocrit Care. 2015;23(1):131–41.

    PubMed  PubMed Central  Article  Google Scholar 

  9. 9.

    Cox CE, Lewis CL, Hanson LC, Hough CL, Kahn JM, White DB, et al. Development and pilot testing of a decision aid for surrogates of patients with prolonged mechanical ventilation. Crit Care Med. 2012;40(8):2327–34.

    PubMed  Article  Google Scholar 

  10. 10.

    Hajizadeh N, Basile M, Andrews J, Kozikowski A, Jacome S, McCullagh L, et al. Informed Together, A Decision Aid To Increase Informed Shared Decision Making About Intubation In Patients With Severe COPD-Results Of Feasibility Testing. A37 THE SPECTRUM OF COPD: EPIDEMIOLOGY TO OUTCOMES. American Thoracic Society. 2017:A1399-A.

  11. 11.

    Khan MW, Muehlschlegel S. Shared decision making in Neurocritical care. Neurosurg Clin N Am. 2018;29(2):315–21.

    PubMed  PubMed Central  Article  Google Scholar 

  12. 12.

    Uhler LM, Perez Figueroa RE, Dickson M, McCullagh L, Kushniruk A, Monkman H, et al. InformedTogether: usability evaluation of a web-based decision aid to facilitate shared advance care planning for severe chronic obstructive pulmonary disease. JMIR Hum Factors. 2015;2(1):e2.

    PubMed  PubMed Central  Article  Google Scholar 

  13. 13.

    Cox CE, Wysham NG, Walton B, Jones D, Cass B, Tobin M, et al. Development and usability testing of a web-based decision aid for families of patients receiving prolonged mechanical ventilation. Ann Intensive Care. 2015;5:6.

    PubMed  PubMed Central  Article  Google Scholar 

  14. 14.

    Ali M, Fulton R, Quinn T, Brady M. How well do standard stroke outcome measures reflect quality of life? A retrospective analysis of clinical trial data. Stroke. 2013;44(11):3161–5.

    PubMed  Article  Google Scholar 

  15. 15.

    Banks JL, Marotta CA. Outcomes validity and reliability of the modified Rankin scale: implications for stroke clinical trials: a literature review and synthesis. Stroke. 2007;38(3):1091–6.

    PubMed  Article  Google Scholar 

  16. 16.

    Bruno A, Akinwuntan AE, Lin C, Close B, Davis K, Baute V, et al. Simplified modified Rankin scale questionnaire: reproducibility over the telephone and validation with quality of life. Stroke. 2011;42(8):2276–9.

    PubMed  Article  Google Scholar 

  17. 17.

    van Swieten JC, Koudstaal PJ, Visser MC, Schouten HJ, van Gijn J. Interobserver agreement for the assessment of handicap in stroke patients. Stroke. 1988;19(5):604–7.

    PubMed  Article  Google Scholar 

  18. 18.

    Fagerlin A, Pignone M, Abhyankar P, Col N, Feldman-Stewart D, Gavaruzzi T, et al. Clarifying values: an updated review. BMC Med Inform Decis Mak. 2013;13(Suppl 2):S8.

    PubMed  PubMed Central  Article  Google Scholar 

  19. 19.

    Recovering After a Stroke: A Patient and Family Guide: US Agency for HealthCare Research and Quality; 1995 May, 1995.

    Google Scholar 

  20. 20.

    HOPE: The stroke recovery guide: National Stroke Association; 2010.

    Google Scholar 

  21. 21.

    Gregorio T, Pipa S, Cavaleiro P, Atanasio G, Albuquerque I, Chaves PC, et al. Prognostic models for intracerebral hemorrhage: systematic review and meta-analysis. BMC Med Res Methodol. 2018;18(1):145.

    PubMed  PubMed Central  Article  Google Scholar 

  22. 22.

    Jampathong N, Laopaiboon M, Rattanakanokchai S, Pattanittum P. Prognostic models for complete recovery in ischemic stroke: a systematic review and meta-analysis. BMC Neurol. 2018;18(1):26.

    PubMed  PubMed Central  Article  Google Scholar 

  23. 23.

    Wing JJ, Bath PM, Zahuranec DB. Abstract 78: Predicting Ordinal Functional Outcome at 90-Days Post Intracerebral Hemorrhage. Stroke. 2019;50(Suppl_1):A78-A.

    Article  Google Scholar 

  24. 24.

    Ali M, Bath P, Brady M, Davis S, Diener HC, Donnan G, et al. Development, expansion, and use of a stroke clinical trials resource for novel exploratory analyses. Int J Stroke. 2012;7(2):133–8.

    PubMed  Article  Google Scholar 

  25. 25.

    Witteman HO, Chipenda Dansokho S, Exe N, Dupuis A, Provencher T, Zikmund-Fisher BJ. Risk communication, values clarification, and vaccination decisions. Risk Anal. 2015;35(10):1801–19.

    PubMed  Article  Google Scholar 

  26. 26.

    Ditto PH, Druley JA, Moore KA, Danks JH, Smucker WD. Fates worse than death: the role of valued life activities in health-state evaluations. Health Psychol. 1996;15(5):332–43.

    PubMed  Article  Google Scholar 

  27. 27.

    Sudore RL. PREPARE for Your Care 2013 [Available from: https://prepareforyourcare.org.

    Google Scholar 

  28. 28.

    Bangor A, Kortum P, Miller J. Determining what individual SUS scores mean: adding an adjective rating scale. J Usability Stud. 2009;4(3):114–23.

    Google Scholar 

  29. 29.

    IconArray.com: Risk Science Center and Center for Bioethics and Social Sciences in Medicine, University of Michigan [Available from: http://www.iconarray.com.

  30. 30.

    Hawley ST, Zikmund-Fisher B, Ubel P, Jancovic A, Lucas T, Fagerlin A. The impact of the format of graphical presentation on health-related knowledge and treatment choices. Patient Educ Couns. 2008;73(3):448–55.

    PubMed  Article  Google Scholar 

  31. 31.

    Zikmund-Fisher BJ, Fagerlin A, Ubel PA. Improving understanding of adjuvant therapy options by using simpler risk graphics. Cancer. 2008;113(12):3382–90.

    PubMed  PubMed Central  Article  Google Scholar 

  32. 32.

    Volandes AE, Mitchell SL, Gillick MR, Chang Y, Paasche-Orlow MK. Using video images to improve the accuracy of surrogate decision-making: a randomized controlled trial. J Am Med Dir Assoc. 2009;10(8):575–80.

    PubMed  PubMed Central  Article  Google Scholar 

  33. 33.

    Curtis JR, White DB. Practical guidance for evidence-based ICU family conferences. Chest. 2008;134(4):835–43.

    PubMed  PubMed Central  Article  Google Scholar 

  34. 34.

    Sudore RL, Boscardin J, Feuz MA, McMahan RD, Katen MT, Barnes DE. Effect of the PREPARE website vs an easy-to-read advance directive on advance care planning documentation and engagement among veterans: a randomized clinical trial. JAMA Intern Med. 2017;177(8):1102–9.

    PubMed  PubMed Central  Article  Google Scholar 

  35. 35.

    Sudore RL, Knight SJ, McMahan RD, Feuz M, Farrell D, Miao Y, et al. A novel website to Prepare diverse older adults for decision making and advance care planning: a pilot study. J Pain Symptom Manag. 2014;47(4):674–86.

    Article  Google Scholar 

  36. 36.

    Muehlschlegel S, Lee C, Quinn T, Moskowitz J, Shutter L, Col N, et al. Employing Shared Decision Making in the Neuro-ICU: Derivation and Feasibility Trial of a Pilot Decision Aid for Goals-of-Care Decisions in Critically-Ill Moderate-Severe Traumatic Brain Injury Patients. Montreal: Society for Medical Decision Making 40th Annual North American Meeting; October 17, 2018; 2018.

    Google Scholar 

  37. 37.

    Cox CE, White DB, Hough CL, Jones DM, Kahn JM, Olsen MK, et al. Effects of a personalized web-based decision aid for surrogate decision makers of patients with prolonged mechanical ventilation: a randomized clinical trial. Ann Intern Med. 2019.

  38. 38.

    Witteman HO, Gavaruzzi T, Scherer LD, Pieterse AH, Fuhrel-Forbis A, Chipenda Dansokho S, et al. Effects of design features of explicit values clarification methods:a systematic review. Med Decis Mak. 2016;36(6):760–76.

    Article  Google Scholar 

  39. 39.

    Witteman HO, Scherer LD, Gavaruzzi T, Pieterse AH, Fuhrel-Forbis A, Chipenda Dansokho S, et al. Design features of explicit values clarification methods:a systematic review. Med Decis Mak. 2016;36(4):453–71.

    Article  Google Scholar 

  40. 40.

    ClinicalTrials.gov: U.S. National Library of Medicine; [Available from: https://clinicaltrials.gov/.

  41. 41.

    Schenker Y, Crowley-Matoka M, Dohan D, Tiver GA, Arnold RM, White DB. I don't want to be the one saying 'we should just let him die': intrapersonal tensions experienced by surrogate decision makers in the ICU. J Gen Intern Med. 2012;27(12):1657–65.

    PubMed  PubMed Central  Article  Google Scholar 

  42. 42.

    White DB. Rethinking interventions to improve surrogate decision making in intensive care units. Am J Crit Care. 2011;20(3):252–7.

    PubMed  PubMed Central  Article  Google Scholar 

  43. 43.

    Tannenbaum AM, Halpern SD. Knowing is (only) half the BattleKnowing is (only) half the Battle. Ann Intern Med. 2019;170(5):338–9.

    PubMed  Article  Google Scholar 

  44. 44.

    Bate P, Robert G. Bringing User Experience to Healthcare Improvement: The Concepts, Methods and Practices of Experience-Based Design. In: Bate, P and Robert, G (2007) Bringing user experience to healthcare improvement: the concepts, methods and practices of experience-based design Radcliffe publishinge, Abingdon, UK ISBN 9781846191763; 2007.

    Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This research was funded by the National Institute of Nursing Research, National Institutes of Health (R21NR016332). The funder provided no role in the conception or design of this study, the acquisition, analysis, interpretation of data and drafting manuscript.

Author information

Affiliations

Authors

Contributions

DZ, CA, and AF contributed to the conception and design of the study. DZ, CA, WN, DE, AF, and EC contributed to the development and usability testing of the Understanding Stroke decision tool. DZ, CA, WN, and EC organized and led the focus groups. SS and AY assisted with content development, as well as interpreting results from the focus group sessions. EC drafted the initial version of the manuscript. All authors edited the manuscript for important content, read, and approved the final manuscript.

Corresponding author

Correspondence to Darin B. Zahuranec.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the Institutional Review Board of the University of Michigan Medical School (IRBMED) (HUM00118298, HUM00145554). Focus group participants gave their written informed consent for participation and analysis of all collected data. Other aspects of tool development (e.g. card sort, usability testing) were determined to not require IRB review.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

Focus Group Demographic Data. Demographic data and characteristics of focus group participants

Additional file 2

Overview of Understanding Stroke. Screenshots of the Understanding Stroke tool content, graphics, and summary report

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Chen, E.P., Arslanian-Engoren, C., Newhouse, W. et al. Development and usability testing of Understanding Stroke, a tailored life-sustaining treatment decision support tool for stroke surrogate decision makers. BMC Palliat Care 19, 110 (2020). https://doi.org/10.1186/s12904-020-00617-x

Download citation