Volume VIII, Number 1 | Spring 2024

Utilizing ChatGPT to isolate novel systematic reviews in field of hand surgery

1McDermott M, 2Mufarreh N, 3Rogers M, 2Bamberger H
1Ohio University , Athens, Ohio, United states; 2Kettering Health Dayton, Dayton, Ohio, United states; 3Ross University, Miramar, Florida, United States

Recently there has been a focus in the medical community on integration of newly advanced technologies into daily practice. One of the recent advancements is ChatGPT released by Open AI. ChatGPT is an open access, artificial intelligence model that can have conversations, answer questions, and learn from individual users. The aim of this study is to delineate a usage of ChatGPT for the hand surgeon and assess the feasibility of incorporation into an aspect of medical practice. The study below begins this process by exploring ChatGPT’s ability to isolate research ideas that have not been explored, or those who have not been updated in the last 10 years, assessing its accuracy for identifying novel research opportunities in the field of hand surgery.

ChatGPT was accessed and asked to come up with 50 specific and novel systematic review ideas for the field of hand surgery. Each of the suggestion were then subjected to a through independent literature review to assess novelty. The literature search was conducted through PubMed (National institutes of health, Bethesda, MD) and the search criteria consisted of reviewing the 50 best matches, filtering for systematic reviews and publication date within the last 10 years. A two-part criterion was established in order to deem a suggestion as novel. First of which the suggestion must not have any similar publication in the literature review. Secondly, the suggestion cannot propose a question that could be answered by a matched publication in the search. Only suggestions that matched both criteria were deemed novel. Results of individual suggestions were tracked to identify an overall accuracy of ChatGPT for this task.

In response to the proposed question, ChatGPT produced 46 suggestions that the program deemed as novel ideas for systematic reviews in hand surgery. From these suggestions, our methods identified 31 of the 46 suggestions as novel, yielding an overall accuracy of 67.4% for ChatGPT for identifying specific and novel systematic reviews in the field of hand surgery.

ChatGPT was successful at identifying specific and novel ideas for systematic reviews in the field of hand surgery. While not every suggestion was truly novel, ChatGPT was able to recognize 31 novel ideas for systematic reviews, showing the utility ChatGPT as an adjunctive tool for expanding hand surgery research. As this technology continues to advance, it is crucial for hand surgeons to consider the use of ChatGPT to help guide their research.

The Journal of the American Osteopathic Academy of Orthopedics

Steven J. Heithoff, DO, FAOAO

To submit an article to JAOAO

Share this content on social media!

Share this content on Facebook
Share this content on X
Share this content on LinkedIn
Authors in this Edition

© AOAO. All copyrights of published material within the JAOAO are reserved.   No part of this publication can be reproduced or transmitted in any way without the permission in writing from the JAOAO and AOAO.  Permission can be requested by contacting Joye Stewart at [email protected].