Introduction: Objective Structured Clinical Examinations (OSCEs) are critical tools in medical education, designed to evaluate clinical competence by engaging students in task such as patient history-taking and physical examination s across multiple stations. Examiners assess student performance using structured rubrics to ensure objective evaluation. The COVID-19 pandemic spurred the adoption of technology in OSCE's, introducing virtual formats to maintain social distancing. While these advancements showcased the need for more interactive and realistic simulations, AI-driven tools like ChatGPT offer potential solutions. With its advanced conversational capabilities, ChatGPT can simulate patient interactions and provide real-time feedback, supporting active learning, experiential engagement, and cognitive management. Rooted in established learning theories, ChatGPT represents a promising avenue to enhance OSCEs by improving the evaluation of clinical competence and enriching experiences. Method: This pilot study engaged 20 faculty members who design and evaluate OSCE scenarios for medical students. Participants utilized ChatGPT in three simulated clinical cases that mirrored traditional OSCE formats. Following the simulations, feedback was collected via a survey to evaluate ChatGPT's effectiveness and usability. Results: The study found that participants appreciated AI a s a standardized patient for its responsiveness, clarity and ability to enhance clinical reasoning while reducing intimidation. However, key challenges included the lack of non-verbal communication, limited empathy, and an inability to perform physical examinations. Technical issues and inconsistent responses also affected the experience. While 20% of participants expressed interest in using AI in future OSCEs, they recommended a hybrid model combining AI with real standardized patients. This approach would leverage AI's strengths while ensuring essential communication, empathy, and practical skills are effectively developed in clinical education. Conclusion: Training ChatGPT to simulate diverse patient scenarios within OSCEs represents a significant innovation in medical education. By offering realistic simulations and precise feedback, ChatGPT has the potential to enhance both assessment accuracy and student preparedness for real-world clinical settings. Keywords: OSCE, Artificial Intelligence, medical education

The authors have declared no competing interest.

This study did not receive any funding

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

St. George's University IRB gave ethical approval for this work

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

All data produced in the present work are contained in the manuscript