An Evaluation of Time Spent Completing Electronically Collected Patient-Reported Outcomes in Clinical Trials

U.S. Department of Health and Human Services FDA Center for Drug Evaluation and Research, U.S. Department of Health and Human Services FDA Center for Biologics Evaluation and Research, and FDA Center for Devices and Radiological Health. Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Health Qual Life Outcomes. 2006. https://doi.org/10.1186/1477-7525-4-79.

Article  Google Scholar 

Gnanasakthy A, Norcross L, DeMuro RC, Carson RT. A review of patient-reported outcome labeling of FDA-approved new drugs (2016–2020): counts, categories, and comprehensibility. Value Health. 2022;25(4):647–55. https://doi.org/10.1016/j.jval.2021.10.006.

Article  PubMed  Google Scholar 

Administration, Federal Drug. Patient focused drug development: incorporating clinical outcome assessments into endpoints for regulatory decision-making. Guidance for Industry, Food and Drug Administration Staff, and Other Stakeholders pp. 1–48. 2023. https://www.fda.gov/media/166830/download.

Apolone G, De Carli G, Brunetti M, Garattini S. Health-related quality of life (HR-QOL) and regulatory issues. An assessment of the European agency for the evaluation of medicinal products (EMEA) recommendations on the use of HR-QOL measures in drug approval. Pharmacoeconomics. 2001;19(2):187–95. https://doi.org/10.2165/00019053-200119020-00005.

Article  CAS  PubMed  Google Scholar 

Bundesausschuss, Gemeinsamer. G-BA submission dossier module. 2021. www.g-ba.de/downloads/17-98-4827/2021-08-03_Anl2_1_Erstellung-Einreichung-Dossier.pdf.

Transparency Committee, Haute Autorité de Santé. Transparency Committee Doctrine, Principles of medicinal products assessment and appraisal for reimbursement purposes. 2020. www.has-sante.fr/upload/docs/application/pdf/2019.

Calvert M, Kyte D, Mercieca-Bebber R, Slade A, Chan AW, King MT, the SPIRIT-PRO Group, and Bottomley A, Regnault A, Chan AW, Ells C, O’Connor D, Revicki D, Patrick D, Altman D, Basch E, Velikova G, Price G, Draper H, Blazeby J, Scott J, Coast J, Norqu Hunn A. Guidelines for inclusion of patient-reported outcomes in clinical trial protocols: the SPIRIT-PRO extension. JAMA. 2018;319(5):483–94. https://doi.org/10.1001/jama.2017.21903.

Article  PubMed  Google Scholar 

Schultz-Knudsen K, Sabaliauskaite U, Hellsten J, Lassen AB, Morant AV. New drug and biologics approvals in 2019: a systematic analysis of patient experience data in FDA drug approval packages and product labels. Ther Innov Regul Sci. 2021;55(3):503–13. https://doi.org/10.1007/s43441-020-00244-x.

Article  PubMed  Google Scholar 

King-Kallimanis BL, Calvert M, Cella D, Cocks K, Coens C, Fairclough D, Howie L, Jonsson P, Mahendraratnam N, Maues J, Sarac S, Shaw J, Stigger N, Trask P, Wieseler B. Perspectives on patient-reported outcome data after treatment discontinuation in cancer clinical trials. Value Health. 2023;26(10):1543–8. https://doi.org/10.1016/j.jval.2023.06.019.

Article  PubMed  Google Scholar 

Aiyegbusi OL, Roydhouse J, Rivera SC, Kamudoni P, Schache P, Wilson R, Stephens R, Calvert M. Key considerations to reduce or address respondent burden in patient-reported outcome (PRO) data collection. Nat Commun. 2022;13(1):6026. https://doi.org/10.1038/s41467-022-33826-4.

Article  CAS  PubMed  PubMed Central  Google Scholar 

Methods, Encyclopedia of Survey Research. Respondent burden definition. 2008.

Yu JY, Goldberg T, Lao N, Feldman BM, Goh YI. Electronic forms for patient reported outcome measures (PROMs) are an effective, time-efficient, and cost-minimizing alternative to paper forms. Pediatr Rheumatol Online. 2021;19(1):67. https://doi.org/10.1186/s12969-021-00551-z.

Article  Google Scholar 

Campbell N, Ali F, Finlay AY, Salek SS. Equivalence of electronic and paper-based patient-reported outcome measures. Qual Life Res. 2015;24(8):1949–61. https://doi.org/10.1007/s11136-015-0937-3.

Article  PubMed  Google Scholar 

Mapi Research Trust. ePROVIDE: Patient-Centered Outcomes Database. 2025. https://eprovide.mapi-trust.org/.

Team, R Studio. RStudio: Integrated Development for R Studio, PBC. RStudio Version 4.3.0. Boston, MA. 2023.

Atkinson TM, Schwartz CE, Goldstein L, Garcia I, Storfer DF, Li Y, Zhang J, Bochner BH, Rapkin BD. Perceptions of response burden associated with completion of patient-reported outcome assessments in oncology. Value Health. 2019;22(2):225–30. https://doi.org/10.1016/j.jval.2018.07.875.

Article  PubMed  Google Scholar 

Rolstad S, Adler J, Rydén A. Response burden and questionnaire length: is shorter better? A review and meta-analysis. Value Health. 2011;14(8):1101–8. https://doi.org/10.1016/j.jval.2011.06.003.

Article  PubMed  Google Scholar 

Nguyen H, Butow P, Dhillon H, Sundaresan P. A review of the barriers to using patient-reported outcomes (PROs) and patient-reported outcome measures (PROMs) in routine cancer care. J Med Radiat Sci. 2021;68(2):186–95. https://doi.org/10.1002/jmrs.421.

Article  PubMed  Google Scholar 

Pew Research Organization. Mobile Fact Sheet. Research Topics: Internet and Technology. 2024. Accessed March 26th, 2024. https://www.pewresearch.org/internet/fact-sheet/mobile/.

Gwaltney CJ, Shields AL, Shiffman S. Equivalence of electronic and paper-and-pencil administration of patient-reported outcome measures: a meta-analytic review. Value Health. 2008;11(2):322–33. https://doi.org/10.1111/j.1524-4733.2007.00231.x.

Article  PubMed  Google Scholar 

EuroQol—a new facility for the measurement of health-related quality of life. The EuroQol Group. Health Policy 1990;6(3):199–208.

Brooks R. EuroQol: the current state of play. Health Policy. 1996;37(1):53–72.

Article  CAS  PubMed  Google Scholar 

De Charro F, Rabin R. EQ-5D from the EuroQol group: an update. QOL Newsletter, 2000; 25 (Full Text Article).

Rabin R, de Charro F. EQ-5D: a measure of health status from the EuroQol group. Ann Med. 2001;33(5):337–43.

Article  CAS  PubMed  Google Scholar 

Bjordal K, de Graeff A, Fayers PM, Hammerlid E, van Pottelsberghe C, Curran D, Ahlner-Elmqvist M, Maher EJ, Meyza JW, Brédart A, Söderholm AL, Arraras JJ, Feine JS, Abendstein H, Morton RP, Pignon T, Huguenin P, Bottomly A, Kaasa S. A 12 country field study of the EORTC QLQ-C30 (version 3.0) and the head and neck cancer specific module (EORTC QLQ-H&N35) in head and neck patients. EORTC Quality of Life Group. Eur J Cancer. 2000;36(14):1796–807.

Article  CAS  PubMed  Google Scholar 

Cella D, Riley W, Stone A, et al. Initial adult health item banks and first wave testing of the patient-reported outcomes measurement information system (PROMISTM) network: 2005–2008. J Clin Epidemiol. 2010;63(11):1179–94.

Article  PubMed  PubMed Central  Google Scholar 

Quality Metric Inc. User’s Manual for the SF-36v2 Health Survey. 3rd edition; 2011: http://www.qualitymetric.com/WhatWeDo/ManualsUserGuides/UsersManusalfortheSF36v2HealthSurvey/tabid/328/Default.aspx.

Cleeland CS, Ryan KM. Pain assessment: global use of the Brief Pain Inventory. Ann Acad Med Singapore. 1994;23(2):129–38.

CAS  PubMed  Google Scholar 

Cleeland CS. Pain assessment in cancer. In: Osaba D, editor. Effect of cancer on quality of life, chapter 21. Boca Raton FL: CRC Press; 1991.

Google Scholar 

Daut RL, Cleeland CS, Flanery RC. Development of the Wisconsin brief pain questionnaire to assess pain in cancer and other diseases. Pain. 1983;17:197–210.

Article  PubMed  Google Scholar 

Stead ML, Brown JM, Velikova G, Kaasa S, Wisløff F, Child JA, Hippe E, Hjorth M, Sezer O, Selby P. Development of an EORTC questionnaire module to be used in health-related quality-of-life assessment for patients with multiple myeloma. European organization for research and treatment of cancer study group on quality of life. Br J Haematol. 1999;104(3):605–11.

Article  CAS  PubMed  Google Scholar 

Cocks K, Cohen D, Wisløff F, Sezer O, Lee S, Hippe E, Gimsing P, Turesson I, Hajek R, Smith A, Graham L, Phillips A, Stead M, Velikova G, Brown J. An international field study of the reliability and validity of a disease-specific questionnaire module (the QLQ-MY20) in assessing the quality of life of patients with multiple myeloma. Eur J Cancer. 2007;43(11):1670–8.

Article  CAS  PubMed  Google Scholar 

Blazeby JM, Hall E, Aaronson NK. Validation and reliability testing of the EORTC QLQ-NMIBC24 questionnaire module to assess patient-reported outcomes in non-muscle-invasive bladder cancer. Eur Urol. 2014;66(6):1148–56.

Article  PubMed  PubMed Central  Google Scholar 

Degboe A, Ivanescu C, Rohay JM, Turner RR, Cella D. Validity and performance of the functional assessment of cancer therapy-bladder (FACT-Bl) among advanced urothelial cancer patients. Support Care Cancer. 2019;27(11):4189–98.

Article  PubMed  PubMed Central  Google Scholar 

Esper P, Mo F, Chodak G, et al. Measuring quality of life in men with prostate cancer using the functional assessment of cancer therapy-prostate instrument. Urology. 1997;50:920–8.

Article  CAS  PubMed  Google Scholar 

Bruce B, Fries J. The Stanford Health assessment questionnaire (HAQ): a review of its history, issues, progress and documentation. J Rheumatol. 2003;30(1):167–78.

PubMed  Google Scholar 

Ramey DR, Fries JF, Singh G. The health assessment questionnaire 1995-status and review. In: Spilker B, editor. Quality of life and pharmacoeconomics in clinical trials. 2nd ed. Philadelphia: Lippincott-Raven Publishers; 1996.

Google Scholar 

Fries JF. The hierarchy of quality-of-life assessment, the health assessment questionnaire (HAQ), and issues mandating development of a toxicity index. Control Clin Trials. 1991;12:106S-S117.

Article  CAS  PubMed  Google Scholar 

Guyatt G, Mitchell A, Irvine EJ, Singer J, Williams N, Goodacre R, Tompkins C. A new measure of health status for clinical trials in inflammatory bowel disease. Gastroenterology. 1989;96(3):804–10.

Article  CAS 

Comments (0)

No login
gif