Evaluation of Chat Generative Pretrained Transformer’s Responses to Frequently Asked Questions about Psoriatic Arthritis: A Study on Quality and Readability
Mehmet Serkan Kılıçoğlu,ozan Volkan Yurdakul,teoman Aydın.
Abstract
Aim: The growing use of artificial intelligence (AI) in healthcare, especially through technologies such as Chat Generative Pretrained Transformer (ChatGPT), has led to concerns regarding the quality and readability of AI-generated health data. This study aimed to evaluate ChatGPT’s responses to frequently asked questions about psoriatic arthritis (PsA).
Methods: The quality of ChatGPT-generated responses was evaluated using the Ensuring Quality Information for Patients (EQIP) tool. Readability was assessed using the Flesch–Kincaid Reading Ease (FKRE) and Flesch–Kincaid Grade Level (FKGL) indices. The Kruskal–Wallis H test was used to compare subgroups, and Bonferroni correction was done for multiple comparisons.
Results: Significant differences were observed in EQIP scores across question subgroups, with treatment-related questions scoring lower than symptom-related questions. The FKRE and FKGL scores indicated that the information provided by ChatGPT could be challenging for patients with lower literacy levels.
Conclusions: Although ChatGPT provided relatively accurate information on PsA, its readability and ability to communicate complex medical information might be improved. These findings suggest the necessity for continual refinement of AI tools to address the diverse needs of patients.
scite shows how a scientific paper has been cited by providing the context of the citation, a classification describing whether it supports, mentions, or contrasts the cited claim, and a label indicating in which section the citation was made.
The articles in Bibliomed are open access articles licensed under Creative Commons Attribution 4.0 International License (CC BY), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
We use cookies and other tracking technologies to work properly, to analyze our website traffic, and to understand where our visitors are coming from. More InfoGot It!
