Evaluating the Efficacy of ChatGPT vs. Google Gemini in Generating Patient Education Materials for GLP-1 Receptor Agonists (Semaglutide, Liraglutide, Tirzepatide): A Cross-Sectional Study.

Evaluating the Efficacy of ChatGPT vs. Google Gemini in Generating Patient Education Materials for GLP-1 Receptor Agonists (Semaglutide, Liraglutide, Tirzepatide): A Cross-Sectional Study.

Karnan, Nithin; Nair, Sruthi; Fidai, Farhaan Firoz; Gurrala, Sri Vidhya; Salim, Jasmine; Gomma, Ahmed
Cureus 2025 Vol. 17 pp. e81993
17
karnan2025evaluating

Abstract

Diabetes management involves using various oral hypoglycemic agents, including new glucagon-like peptide-1 (GLP-1) receptor agonists like semaglutide, tirzepatide, and liraglutide. Artificial intelligence (AI) tools such as ChatGPT (OpenAI, San Francisco, United States) and Google Gemini (Google DeepMind, London, United Kingdom) provide an innovative approach to creating patient education materials, potentially enhancing the accessibility and understanding of medical information. Thus, the study aimed to compare the effectiveness of ChatGPT and Google Gemini in generating patient education brochures for semaglutide, tirzepatide, and liraglutide. Key criteria included readability, similarity, and reliability of the generated content. The cross-sectional study design was conducted in June 2024, involving data collection from ChatGPT-3.5 and Google Gemini. Each AI tool generated educational brochures for the three medications. The responses were evaluated using Flesch-Kincaid readability scores, Quillbot similarity analysis, and a modified DISCERN instrument for reliability assessment. Statistical analysis included univariate t-tests and Pearson's coefficient of correlation via RStudio v4.3.2 (Posit, Boston, United States). ChatGPT generated longer brochures with higher word counts compared to Google Gemini, which had better readability scores. Similarity analysis showed that Google Gemini's content had a higher percentage of overlap. Both AI tools demonstrated high reliability scores, with no significant difference between them. Google Gemini provided more readable content, while ChatGPT produced slightly more detailed information. Both AI tools were effective in generating reliable patient education materials for GLP-1 receptor agonists. However, future research should incorporate more AI tools and updated versions for comprehensive analysis.

Citation

ID: 283216
Ref Key: karnan2025evaluating
Use this key to autocite in SciMatic or Thesis Manager

References

Blockchain Verification

Account:
NFT Contract Address:
0x95644003c57E6F55A65596E3D9Eac6813e3566dA
Article ID:
283216
Unique Identifier:
10.7759/cureus.81993
Network:
Scimatic Chain (ID: 481)
Loading...
Blockchain Readiness Checklist
Authors
Abstract
Journal Name
Year
Title
5/5
Creates 1,000,000 NFT tokens for this article
Token Features:
  • ERC-1155 Standard NFT
  • 1 Million Supply per Article
  • Transferable via MetaMask
  • Permanent Blockchain Record
Blockchain QR Code
Scan with Saymatik Web3.0 Wallet

Saymatik Web3.0 Wallet