Skip to main content

Supportive and palliative care indicators tool (SPICT™): content validity, feasibility and pre-test of the Italian version

Abstract

Background

Difficulties in identifying patients at risk of clinical deterioration or death represent one of the main barriers to Palliative Care (PC) development in the community. Currently, no specific Italian tools aimed at identifying patients with PC needs are available. Of the different European tools available, the SPICT™ can be used easily in any kind of setting and does not include the Surprise Question. The purpose of the study was to translate, cross-culturally adapt and pre-test the Italian version of the SPICT™.

Methods

The Beaton recommendations for the cross-cultural adaptation of instruments were followed. Content validity was assessed using the Lynn method. A sample of Italian General Practitioners (GPs) assessed the SPICT-IT™ for feasibility and tested it.

Results

During the cross-cultural adaptation, some issues regarding semantic, experiential, idiomatic and conceptual equivalences were raised and resolved. The Scale-Content Validity Index/Ave was 0.86. Of the 907 GPs included in the sample, 71 (7.8%) agreed to test the SPICT-IT™ and to assess its feasibility. The participants provided care for 73,526 people in the community. Of these people, 1.7% (N = 1303) were identified as being in need of PC according to the SPICT-IT™. Sixty-six (93.0%) GPs stated they would use the SPICT-IT™ in their daily clinical practice.

Conclusions

The SPICT-IT™ demonstrated acceptable content validity. The percentage of patients identified through the SPICT-IT™ was comparable to findings from literature. The next phase of this project will investigate the impact of a proactive training programme aimed at supporting GPs in identifying patients with PC needs and delivering appropriate Primary Palliative Care (PPC).

Peer Review reports

Background

Difficulties in identifying patients at risk of clinical deterioration or death have been recognised as one of the main barriers for palliative care (PC) development and integration in the community [1]. European countries have been encouraged by the World Health Organization (WHO) to develop research initiatives that aim to overcome the barriers to Primary Palliative Care (PPC) development [1, 2].

Identification of those individuals who may benefit from palliative care early in their illness trajectory should be the first step in PPC development. Patients identified as at risk of deteriorating or of dying, will still require assessment of symptoms and needs across all domains to determine whether they would benefit from PC, or if they have unmet PC needs. Through identification and assessment GPs will be able to plan and manage the most appropriate care for patients [3].

Effective end-of-life-care planning must begin with the identification of patients at risk of dying. Recent literature reports that several diagnostic [4] symptoms and needs assessment tools [5] are available. Assessment tools or patient-report outcome measures are often used, especially in cancer patients [6]. The available diagnostic or screening tools (used by clinicians) for the identification of patients at risk of deterioration or death, although very useful for helping general practitioners (GPs), are rarely used in clinical practice [7].

The Supportive and Palliative Care Indicators Tool (SPICT™) (see Additional file 1) is one of those tools. It is easy to use, complete and supports clinicians in identifying unmet needs through actual care evaluation and the analysis of signs of deterioration in adult patients (age > 18); its use is approved for both primary care and acute hospitals [8]. The SPICT™ does not include the Surprise Question (SQ) and through its use, the risk of “prognostic paralysis” (associated with predicting life expectancy), which may result in the delayed identification of people with PC needs, is avoided [9]. Patients with PC needs could have a prognosis of over 1 year, especially where conditions other than cancer are concerned. The SPICT™ was originally developed in 2010 by the Primary Palliative Care Research Group of the University of Edinburgh to help clinicians identify patients with advanced conditions who might benefit from primary or, in some cases, specialised PC [8]. It comprises a set of clinical indicators and has a three-part structure. The first section consists of general clinical indicators, the second details specific illness indicators and the third provides essential recommendations for reviewing and planning care [8, 10]. Physicians working in any kind of care setting can screen patients using the checklist of indicators included in the SPICT™. People who have been identified as needing PC by means of the SPICT™ usually have at least two general indicators [10, 11]. The SPICT™ has been translated and culturally adapted in different languages, but not Italian [10, 12]. This absence could limit both national development of PC and comparisons with other European countries. Therefore, the main aim of this study was to translate, culturally adapt and assess the content validity and feasibility of the SPICT-IT™. The secondary aims were to test the SPICT-IT™ with the help of a sample of general practitioners (GPs) and to assess how frequently the tools for identification of PC needs are used in real-life scenarios.

Methods

Lazio 1 Ethics Committee (Rome, Italy) approved the study. Permission to translate the SPICT™ was provided by the Edinburgh Primary Palliative Care Research Group.

Translation and cross-cultural adaptation

The Italian translation and cross-cultural adaptation of the SPICT™ was carried out according to the Beaton protocol [13] and the WHO recommendations for translation and adaptation of instruments [14].

Stage 1: Two native Italian speakers translated the tool into Italian, with the translations done in parallel, but independently.

Stage 2: The two translators synthesised the results of the translations. A written report was produced to document the synthesis process.

Stage 3: A translator who did not have a medical background and whose native language was English performed the back translation. Agreement between the translated version and the original version was verified to ensure that the content of the translated version matched that of the original.

Stage 4: A panel of 10 experts reviewed the translated version to reach a consensus on any discrepancies. The expert committee was composed of: 1 methodology researcher, 1 physician with an advanced degree in internal medicine, 2 GPs, 2 PC physicians, 1 oncologist, 1 nurse researcher, 1 PC nurse and the two native Italian translators. Any issues regarding semantic, idiomatic, experiential or conceptual equivalences were discussed and resolved. Subsequently, the pre-final version of the SPICT-IT™ was submitted to a panel of 11 experts (different from the 10 experts involved in the first panel) for assessment of the SPICT-IT™ content validity [15, 16]. The panel consisted of 5 GPs, 1 neurologist, 1 oncologist, 1 geriatrician, 1 respiratory medicine specialist, 1 cardiologist and 1 gastroenterologist; each of these individuals had documented experience in delivering PC. The experts received an anonymised electronic questionnaire in which they were asked to rate each of the clinical indicators, in terms of clarity and relevancy, on a four-point Likert scale (not relevant = 1; somewhat relevant = 2; quite relevant = 3; highly relevant = 4). Finally, an electronic questionnaire, together with the SPICT-IT™, was distributed to all GPs (N = 907) in the Roma 1 Local Health Authority for feasibility assessment and testing. Each healthcare district director encouraged the GPs to take part in this project by sending a letter that explained the importance of developing PPC in Italy. Each GP was asked to provide the total number of patients (age > 18) in care at the time of submitting the questionnaire. Furthermore, they were asked to identify how many of these patients (age > 18) had at least 2 general indicators and 1 specific indicator from among those included in the SPICT-IT™.

Statistical analysis

Quantitative data were analysed with descriptive statistics. If they were related to the quantitative variables, data were summarised by using means, standard deviations, medians and ranges. The Content Validity Index for Item (CVI-I) was calculated as the relationship between the number of experts on the panel who rated the indicators 3–4 and the total number of experts for each of the clinical indicators. The Content Validity Index for Scale (CVI-S) was calculated by using the S-CVI/Average as included in the Lynn method (an S-CVI/Ave >.80 is the standard criterion for acceptability for the S-CVI) [15]. The multi-rater kappa statistic, with an adjustment for a chance agreement, was calculated to supplement the I-CVI because the kappa statistic provides information concerning the degree of agreement beyond chance (kappa values are considered excellent when above 0.74, good between 0.60 and 0.74, and fair between 0.40 and 0.59) [16].

Results

During the cross-cultural adaptation of the SPICT™, researchers identified the following main discrepancies with respect to the four types of equivalences:

Semantic equivalence

  • The experts agreed to add “mechanical, invasive or non-invasive ventilation” to the item known as “has needed ventilation”, to specify that non-invasive ventilation also had to be considered.

  • The expression “plan care” was not literally translated because the experts believed that it may result in healthcare professionals (HCPs) considering only “medical care”.

Conceptual equivalence

  • The experts agreed that the literal translation of “too frail for cancer treatment” was not easy to understand in Italian; therefore, it was translated as “general status that does not allow starting or continuing specific cancer treatment”.

Idiomatic equivalence

  • The expression “life-limiting conditions” was not literally translated. The panel decided to translate it as “conditions with a limited prognosis”.

Experiential equivalence

  • The word “unmet” that was used before “PC needs” may result in HCPs underestimating the number of patients to be identified. The panel agreed to omit the word “unmet” in the Italian version to avoid this potential problem.

The multi-rater kappa statistic, which was adjusted for a chance agreement, was > 0.74 for all items. The S-CVI/Ave was 0.86.

Of the 907 GPs invited to take part in the study, 71 (7.8%) GPs agreed to participate and responded to the questionnaire. Males comprised 61% of participating GPs, and the mean age was 58.3 ± 8.7 (Table 1). The mean time for reading and applying the SPICT-IT™ was 8.5 ± 5.3 min. 97.2% (N = 69) of GPs reported that the SPICT-IT™ was clear and comprehensible. Two GPs reported that the SPICT-IT™ included too many indicators, and that it was repetitive and too complex. The GPs who participated in the study provided care for 73,526 people (Table 1) in total. Of these, 1303 patients had at least 2 general indicators and 1 specific indicator for illnesses. A mean of 1.7% of individuals was therefore identified as requiring PC (Table 1). 94.4% (N = 67) of the GPs stated that they never use any tools for identifying PC needs. Four GPs reported that clinical evidence is sufficient for identifying patients with PC needs and that “good sense is the best tool”. However, 93.0% (N = 66) of the GPs stated that they would use the SPICT-IT™ in daily clinical practice.

Table 1 GPs characteristics

Discussion

Demographic changes across Europe, such as an aging population and the rise of chronic degenerative diseases, highlight the increasing numbers of people with PC needs [17].

In 2014 the WHO Global Atlas of PC at the End of Life clarified the inclusive nature of PC, stating that PC should also be delivered to patients who are affected by chronic conditions, that it should be provided in any setting on the basis of need and not based on diagnosis or prognosis [18]. Consequently, accurate identification of people with PC needs is essential for the development of PC at all levels. Furthermore, early PC interventions proved effective in improving quality of life [19, 20]. In this context, the research presented here is an essential initiative that aims to contribute to PC development. During the translation and cultural adaptation process, minimal linguistic or cultural discrepancies were encountered. Generally, a good level of content validity was observed in the SPICT-IT™. Our group of GPs’ average time for applying the SPICT-IT™ was shorter than the reported time for application of the Spanish translation [11]. We believe that use of the SPICT-IT™ as part of routine care in real-life clinical contexts would reduce the time required even further as clinicians grew familiar with it. In this study, 7.8% of the GPs approached agreed to participate. This confirms the difficulties involved in recruiting GPs for PC-focussed projects. Data from a recent study reported that of 4065 eligible GPs, only 2.8% agreed to participate in a PPC research in Belgium [21]. Tailored training programmes should be implemented to encourage more GPs to take part in this type of research.

The prevalence of patients who were identified through the SPICT-IT™ (1.7%) was similar to that reported in a recent Italian multicentre study [22].

Study limitations

This study has some limitations.

First of all, the Beaton method is commonly used for cross-cultural adaptation of self-report measures, while the SPICT™ is a set of clinical indicators. Secondly, the low response rate from GPs will require further interventions to raise GPs’ awareness on the importance of promoting PC research. Finally, the validity of the SPICT-IT™ should be further assessed by registering and monitoring data of identified patients.

Conclusion

The Italian version of the SPICT™ exhibited acceptable feasibility and content-validity. The prevalence of patients in need of PC who were identified through the SPICT-IT™ was similar to that reported in literature. The next phase of this project is under way, and it will provide information for interactive educational programmes concerning the use of PPC for GPs and hospital physicians. Alongside the better use of effective tools to identify people with palliative care needs, there should be development and dissemination of these tools to help clinicians assess the nature and complexity of PC needs and deliver the most appropriate care for this population.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

GP:

General Practitioner

PC:

Palliative Care

WHO:

World Health Organization

PPC:

Primary Palliative Care

SPICT:

Supportive and Palliative Care Indicators Tool

CVI-I:

Content Validity Index for Item

CVI-S:

Content Validity Index for Scale

HCP:

Healthcare professional

References

  1. 1.

    Murray SA, Firth A, Schneider N, et al. Promoting palliative care in the community: production of the primary palliative care toolkit by the European Association of Palliative Care Taskforce in primary palliative care. Palliat Med. 2015;29(2):101–11.

    Article  Google Scholar 

  2. 2.

    World Health Organization. Strengthening of palliative care as a component of integrated treatment throughout the life course. J Pain Palliat Care Pharmacother. 2014;28(2):130–4.

    Article  Google Scholar 

  3. 3.

    Clifford C, Thomas K, Armstrong Wilson J. Going for Gold: the Gold Standards Framework programme and accreditation in primary care. End Life J. 2016;6:e000028. https://doi.org/10.1136/eoljnl2016-000028.

    Article  Google Scholar 

  4. 4.

    Walsh RI, Mitchell G, Francis L, van Driel ML. What diagnostic tools exist for the early identification of palliative care patients in general practice? A systematic review. J Palliat Care. 2015;31(2):118–23.

    Article  Google Scholar 

  5. 5.

    Bausewein C, Daveson BA, Currow, et al. EAPC white paper on outcome measurement in palliative care: improving practice, attaining outcomes and delivering quality services–recommendations from the European Association for Palliative Care (EAPC) task force on outcome measurement. Palliat Med. 2016;30(1):6–22.

    Article  Google Scholar 

  6. 6.

    Collins ES, Witt J, Bausewein C, et al. A systematic review of the use of the palliative care outcome scale and the support team assessment schedule in palliative care. J Pain Symptom Manage. 2015;50(6):842–853. e19. https://doi.org/10.1016/j.jpainsymman.2015.07.015.

    Article  PubMed  Google Scholar 

  7. 7.

    Maas EAT, Murray SA, Engels Y, et al. What tools are available to identify patients with palliative care needs in primary care: a systematic literature review and survey of European practice. BMJ Support Palliat Care. 2013;3(4):444–51.

    Article  Google Scholar 

  8. 8.

    Highet G, Crawford D, Murray SA, et al. Development and evaluation of the supportive and palliative care indicators tool (SPICT): a mixed-methods study. BMJ Support Palliat Care. 2014;4(3):285–90.

    Article  Google Scholar 

  9. 9.

    Downar J, Goldman R, Pinto R, Englesakis M, Adhikari NK. The “surprise question” for predicting death in seriously ill patients: a systematic review and meta-analysis. CMAJ. 2017;189(13):E484–93.

    Article  Google Scholar 

  10. 10.

    Afshar K, Feichtner A, Boyd K, et al. Systematic development and adjustment of the German version of the supportive and palliative care indicators tool (SPICT-DE). BMC Palliat Care. 2018;17(1):27.

    Article  Google Scholar 

  11. 11.

    De Bock R, Van Den Noortgate N, Piers R, et al. Validation of the supportive and palliative care indicators tool in a geriatric population. J Palliat Med. 2018;21(2):220–4.

    Article  Google Scholar 

  12. 12.

    Fachado AA, Martínez NS, Roselló MM, et al. Spanish adaptation and validation of the supportive & palliative care indicators tool - SPICT™-ES. Rev Saúde Pública. 2018;52:3.

    Article  Google Scholar 

  13. 13.

    Beaton DE, Bombardier C, Guillemin F, et al. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25(24):3186–91.

    CAS  Article  Google Scholar 

  14. 14.

    World Health Organization, et al. Process of translation and adaptation of instruments. https://www.who.int/substance_abuse/research_tools/translation/en/ Accessed 20 Dec 2019.

  15. 15.

    Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30(4):459–67.

    Article  Google Scholar 

  16. 16.

    Zamanzadeh V, Ghahramanian A, Rassouli M, et al. Design and implementation content validity study: development of an instrument for measuring patient-centered communication. J Caring Sci. 2015;4(2):165–78.

    Article  Google Scholar 

  17. 17.

    Brennan P, Perola M, Van Ommen GJ, et al. Chronic disease research in Europe and the need for integrated population cohorts. Eur J Epidemiol. 2017;32(9):741–9.

    Article  Google Scholar 

  18. 18.

    Global Atlas of Palliative Care at the end of life. Link to: https://www.who.int/nmh/Global_Atlas_of_Palliative_Care.pdf Accessed 28 March 2019.

  19. 19.

    Temel JS, Greer JA, Muzikansky, et al. Early palliative care for patients with metastatic non-small-cell lung cancer. N Engl J Med. 2010;363:733–42.

    CAS  Article  Google Scholar 

  20. 20.

    Zimmermann C, Swami N, Krzyzanowska M, et al. Early palliative care for patients with advanced cancer: a cluster-randomised controlled trial. Lancet. 2014;383:1721–30.

    Article  Google Scholar 

  21. 21.

    Leysen B, Van den Eynden B, Janssens A, et al. Recruiting general practitioners for palliative care research in primary care: real-life barriers explained. BMC Fam Pract. 2019;20(1):40.

    CAS  Article  Google Scholar 

  22. 22.

    Scaccabarozzi G, Amodio E, Pellegrini G, et al. The “ARIANNA” project: an observational study on a model of early identification of patients with palliative care needs through the integration between primary care and Italian home palliative care units. J Palliat Med. 2018;21(5):631–7.

    Article  Google Scholar 

Download references

Acknowledgements

Our thanks to the SPICT-IT™ study group (panel of experts): Maurizio Cancian, Marco Colotto, Antonella Di Giacomo, Giuseppe Fucito, Giorgio Gentili, Patrizia Latorre, Pierangelo Lora Aprile, Michele Massaro, Andrea Pace, Antonella Savarese, Simone Scarlata, Maria Consiglia Stefanelli, and Adriana Turriziani. Thanks to all participants who took part in testing SPICT-IT™. Thanks to the Pace - Lo Bianco family for their support and all of the GPs who gave their time to participate in this study. A portion of this work was presented at the 16th World Congress of the European Association for Palliative Care.

Funding

None.

Author information

Affiliations

Authors

Consortia

Contributions

CMag and CMas had the original idea for the study. CMag, CMas, DD wrote the study protocol. LS and CMag made important contributions to the translation process. RF, MG and GC contributed to the implementation of the study. CM wrote the manuscript. KB reviewed the manuscript. CMas and LS performed the final revision of the manuscript to respond to the referees’ comments. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Laura Surdo.

Ethics declarations

Ethics approval and consent to participate

The study was approved by Lazio 1 Ethics Committee, Rome 17th January 2018 (Prot. 110/CE Lazio 1). All participants gave their written informed consent.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Casale, G., Magnani, C., Fanelli, R. et al. Supportive and palliative care indicators tool (SPICT™): content validity, feasibility and pre-test of the Italian version. BMC Palliat Care 19, 79 (2020). https://doi.org/10.1186/s12904-020-00584-3

Download citation

Keywords

  • Palliative care
  • SPICT
  • Italian
  • Supportive care
  • Primary care