The implications of artificial intelligence in clinical healthcare: a scoping review on regulatory challenges up to 2023

Topol EJ. High-performance medicine: the convergence of human and artificial intelligence. Nat Med. 2019;25(1):44–56. https://doi.org/10.1038/s41591-018-0300-7.

Article  Google Scholar 

Penteado BE, Fornazin M, Castro L. The evolution of artificial intelligence in medical informatics: A bibliometric analysis. In: Marreiros G, Melo FS, Lau N, Cardoso L, Reis H, L.P, editors. Progress in artificial intelligence. EPIA 2021. Lecture notes in computer science. Volume 12981. Cham: Springer; 2021. https://doi.org/10.1007/978-3-030-86230-5_10.

Cabral BP, Braga LAM, Conte Filho CG, Penteado B, Freire de Castro Silva SL, Castro L, Fornazin M, Mota F. Future use of AI in diagnostic medicine: 2-wave cross-sectional survey study. J Med Internet Ressearch. 2025;27:e53892. https://doi.org/10.2196/53892.

Article  Google Scholar 

IMDRF. (2013). IMDRF SaMD Working Group. Software as a Medical Device (SaMD): Key Definitions. Https://Www.Imdrf.Org/Sites/Default/Files/Docs/Imdrf/Final/Technical/Imdrf-Tech-131209-Samd-Key-Definitions-140901.Pdf

Iqbal JD, Biller-Andorno N. The regulatory gap in digital health and alternative pathways to bridge it. Health Policy Technol. 2022. https://doi.org/10.1016/j.hlpt.2022.100663.

Article  Google Scholar 

Lexology. (2023). Quickly notes about the use of personal data by Brazilian pharmacies. Available at: https://www.lexology.com/library/detail.aspx?g=222bb3d9-8579-4dd5-b60d-2325e1592e8e

Babic B, Gerke S, Evgeniou T, Cohen IG. Direct-to-consumer medical machine learning and artificial intelligence applications. Nat Mach Intell. 2021;3(4):283–7. https://doi.org/10.1038/s42256-021-00331-0.

Article  Google Scholar 

Penteado BE, Fornazin M, Castro L, Rachid R. (2022). The Regulation of Artificial Intelligence In Healthcare: an exploratory study: Research in Progress. SIGMIS-CPR 2022 - Proceedings of the 2022 Computers and People Research Conference: Redefining the IT Profession and the Human Role of the IT Professional. https://doi.org/10.1145/3510606.3551898

de Miguel I, Sanz B, Lazcoz G. Machine learning in the EU health care context: exploring the ethical, legal and social issues. Inf Commun Soc. 2020;23(8):1139–53. https://doi.org/10.1080/1369118X.2020.1719185.

Article  Google Scholar 

Oliva A, Grassi S, Vetrugno G, Rossi R, Della Morte G, Pinchi V, Caputo M. (2022). Management of Medico-Legal Risks in Digital Health Era: A Scoping Review. In Frontiers in Medicine (Vol. 8). Frontiers Media S.A. https://doi.org/10.3389/fmed.2021.821756

Čartolovni A, Tomičić A, Lazić Mosler E. Ethical, legal, and social considerations of AI-based medical decision-support tools: A scoping review. Int J Med Informatics. 2022;161. https://doi.org/10.1016/j.ijmedinf.2022.104738. Elsevier Ireland Ltd.

Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, Moher D, Peters MDJ, Horsley T, Weeks L, Hempel S, Akl EA, Chang C, McGowan J, Stewart L, Hartling L, Aldcroft A, Wilson MG, Garritty C, Straus SE. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467–73. https://doi.org/10.7326/M18-0850.

Article  Google Scholar 

Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101. https://doi.org/10.1191/1478088706qp063oa.

Article  Google Scholar 

Price WN, Cohen IG. (2019). Privacy in the age of medical big data. In Nature Medicine (Vol. 25, Issue 1, pp. 37–43). Nature Publishing Group. https://doi.org/10.1038/s41591-018-0272-7

Forcier MB, Gallois H, Mullan S, Joly Y. Integrating artificial intelligence into health care through data access: can the GDPR act as a beacon for policymakers? Journal of law and the biosciences. Volume 6. Oxford University Press; 2019. pp. 317–35. 1https://doi.org/10.1093/jlb/lsz013.

Forti M. The deployment of artificial intelligence tools in the health sector: privacy concerns and regulatory answers within the GDPR. Eur J Legal Stud. 2021;13(1):29–44.

Google Scholar 

Kayaalp M. (2018). Patient privacy in the era of big data. In Balkan Medical Journal (Vol. 35, Issue 1, pp. 8–17). Galenos Publishing House. https://doi.org/10.4274/balkanmedj.2017.0966

Van Kolfschooten H. Eu regulation of artificial intelligence: challenges for patients’ rights. Common Market Law Rev. 2022;59(1):81–112. https://doi.org/10.54648/cola2022005.

Article  Google Scholar 

Murdoch B, Jandura A, Caulfield T. Privacy considerations in the Canadian regulation of commercially-operated healthcare artificial intelligence. Can J Bioeth. 2022;5(4):44–52. https://doi.org/10.7202/1094696ar.

Article  Google Scholar 

Dri DA, Massella M, Gramaglia D, Marianecci C, Petraglia S. Clinical trials and machine learning: regulatory approach review. Rev Recent Clin Trials. 2021;16(4):341–50. https://doi.org/10.2174/1574887116666210715114203.

Article  Google Scholar 

Maliha G, Gerke S, Cohen IG, Parikh RB. Artificial intelligence and liability in medicine: balancing safety and innovation. Milbank Q. 2021;99(3):629–47. https://doi.org/10.1111/1468-0009.12504.

Article  Google Scholar 

Niemiec E. Will the EU medical device regulation help to improve the safety and performance of medical AI devices? Digit Health. 2022. https://doi.org/10.1177/20552076221089079.

Article  Google Scholar 

McCradden MD, Joshi S, Anderson JA, Mazwi M, Goldenberg A, Shaul RZ. (2020). Patient safety and quality improvement: Ethical principles for a regulatory approach to bias in healthcare machine learning. In Journal of the American Medical Informatics Association (Vol. 27, Issue 12, pp. 2024–2027). Oxford University Press. https://doi.org/10.1093/jamia/ocaa085

McKee M, Wouters OJ. The challenges of regulating artificial intelligence in healthcare comment on clinical decision support and new regulatory frameworks for medical devices: are we ready for It?-A viewpoint paper. Int J Health Policy Manage. 2023;12(1). https://doi.org/10.34172/ijhpm.2022.7261.

Minssen T, Gerke S, Aboy M, Price N, Cohen G. Regulatory responses to medical machine learning. J Law Biosci. 2020. https://doi.org/10.1093/jlb/lsaa002.

Article  Google Scholar 

Thomasian NM, Eickhoff C, Adashi EY. Advancing health equity with artificial intelligence. J Public Health Policy. 2021;42(4):602–11. https://doi.org/10.1057/s41271-021-00319-5.

Article  Google Scholar 

Guarda P. Ok google, am I sick? Artificial intelligence, e-health, and data protection regulation. BioLaw J. 2019;1:359–75.

Google Scholar 

Morrell W, Shachar C, Weiss AP. The oversight of autonomous artificial intelligence: lessons from nurse practitioners as physician extenders. J Law Biosci. 2022. https://doi.org/10.1093/jlb/lsac021.

Article  Google Scholar 

Onitiu D. The limits of explainability & human oversight in the EU commission’s proposal for the regulation on AI- a critical approach focusing on medical diagnostic systems. Inform Commun Technol Law. 2023;32(2):170–88. https://doi.org/10.1080/13600834.2022.2116354.

Article  Google Scholar 

Svensson AM, Jotterand F. Doctor ex machina: a critical assessment of the use of artificial intelligence in health care. J Med Philos. 2022;47(1):155–78. https://doi.org/10.1093/jmp/jhab036.

Article  Google Scholar 

Mourby M, Ó Cathaoir K, B Collin C. Transparency of machine-learning in healthcare: the GDPR & European health law. Comput Law Secur Rev. 2021;43. https://doi.org/10.1016/j.clsr.2021.105611.

Benrimoh D, Israel S, Perlman K, Fratila R, Krause M. Meticulous transparency—an evaluation process for an agile AI regulatory scheme. Lecture Notes Comput Sci (Including Subser Lecture Notes Artif Intell Lecture Notes Bioinformatics). 2018;10868 LNAI:869–80. https://doi.org/10.1007/978-3-319-92058-0_83.

Article  Google Scholar 

Johnson SLJ. Artificial intelligence in health care: the challenge of effective regulation. J Legal Med. 2022;42(1–2):75–86. https://doi.org/10.1080/01947648.2022.2158682.

Article  Google Scholar 

Morley J, Machado CCV, Burr C, Cowls J, Joshi I, Taddeo M, Floridi L. The ethics of AI in health care: A mapping review. Soc Sci Med. 2020;260. https://doi.org/10.1016/j.socscimed.2020.113172. Elsevier Ltd.

Zhang J, Zhang Zming. Ethics and governance of trustworthy medical artificial intelligence. BMC Med Inform Decis Mak. 2023. https://doi.org/10.1186/s12911-023-02103-9.

Article  Google Scholar 

Lagioia F, Contissa G. The strange case of dr. Watson: liability implications of Ai evidence-based decision support systems in health care. Eur J Legal Stud. 2020;12(2):245–89. https://doi.org/10.2924/EJLS.2019.028.

Article  Google Scholar 

Naik N, Hameed BMZ, Shetty DK, Swain D, Shah M, Paul R, Aggarwal K, Brahim S, Patil V, Smriti K, Shetty S, Rai BP, Chlosta P, Somani BK. Legal and ethical consideration in artificial intelligence in healthcare: who takes responsibility?? Front Surg. 2022;9. https://doi.org/10.3389/fsurg.2022.862322.

Zaiarnyi O. (2018). Directions for Improving the Legal Liability of Medical Organizations for Artificial Intelligence Systems Application. In Artificial Intelligence Systems Application (Vol. 37, Issue 2). http://medicallaw.org.ua/fileadmin/user

Becker K, Lipprandt M, Röhrig R, Neumuth T. Digital health - Software as a medical device in focus of the medical device regulation (MDR). IT-Inf Technol. 2019;61(5–6):211–8. https://doi.org/10.1515/itit-2019-0026.

Article  Google Scholar 

Chinzei K, Shimizu A, Mori K, Harada K, Takeda H, Hashizume M, Ishizuka M, Kato N, Kawamori R, Kyo S, Nagata K, Yamane T, Sakuma I, Ohe K, Mitsuishi M. Regulatory science on AI-based medical devices and systems. In Advanced biomedical engineering. Japan Soc Med Electron Biol Eng. 2018;7:118–23. https://doi.org/10.14326/abe.7.118.

Article  Google Scholar 

Mohd Shith Putera NSF, Abdullah SM, Abdul Rahman N, Hassan A, Saripan R, Haryanto I. Malaysian medical device regulation for artificial intelligence in healthcare: have all the pieces fallen into position? Environment-Behaviour Proceedings Journal. 2021;6(16):137–44. https://doi.org/10.21834/ebpj.v6i16.2635.

Article  Google Scholar 

Arima H, Kano S. Integrated analytical framework for the development of artificial Intelligence-based medical devices. Ther Innov Regul Sci. 2021;55(4):853–65. https://doi.org/10.1007/s43441-021-00292-x.

Article  Google Scholar 

Gilbert S, Fenech M, Hirsch M, Upadhyay S, Biasiucci A, Starlinger J. Algorithm change protocols in the regulation of adaptive machine learning-based medical devices. J Med Internet Res (Vol. 2021;23. https://doi.org/10.2196/30545. Issue 10). JMIR Publications Inc.

Hassan S, Dhali M, Zaman F, Tanveer M. Big data and predictive analytics in healthcare in Bangladesh: regulatory challenges. Heliyon. 2021. https://doi.org/10.1016/j.heliyon.2021.e07179.

Article  Google Scholar 

Lim K, Heo TY, Yun J. (2022). Trends in the Approval and Quality Management of Artificial Intelligence Medical Devices in the Republic of Korea. In Diagnostics (Vol. 12, Issue 2). MDPI. https://doi.org/10.3390/diagnostics12020355

Muehlematter UJ, Daniore P, Vokinger KN. Approval of artificial intelligence and machine learning-based medical devices in the USA and Europe (2015–20): a comparative analysis. The lancet digital health. Volume 3. Elsevier Ltd; 2021. pp. e195–203. 3https://doi.org/10.1016/S2589-7500(20)30292-2.

Palmieri S, Walraet P, Goffin T. Inevitable influences: AI-based medical devices at the intersection of medical devices regulation and the proposal for AI regulation. Eur J Health Law. 2021. https://doi.org/10.1163/15718093-bja10053.

Article  Google Scholar 

Richards B, Jacobson SS, Saint Y, Aquino J. (2021). AI in Medicine Must Be Rigorously Tested (2018) 361 The British Medical Journal k1752. In Technology Health Law Issues (Vol. 646). http://sites.thomsonreuters.com.au/

Smith JA, Abhari RE, Hussain Z, Heneghan C, Collins GS, Carr AJ. Industry ties and evidence in public comments on the FDA framework for modifications to artificial intelligence/machine learning-based medical devices: a cross sectional study. BMJ Open. 2020. https://doi.org/10.1136/bmjopen-2020-039969.

Article  Google Scholar 

Vokinger KN, Gasser U. Regulating AI in medicine in the united States and europe. Nat Mach Intell. 2021;3:738–9. https://doi.org/10.1038/s42256-021-00386-z.

Article  Google Scholar 

Yaeger KA, Martini M, Yaniv G, Oermann EK, Costa AB. United states regulatory approval of medical devices and software applications enhanced by artificial intelligence. Health Policy Technol. 2019;8(2):192–7. https://doi.org/10.1016/j.hlpt.2019.05.006.

Article 

Comments (0)

No login
gif