Generative AI Meets Cataloging Practice: Findings from a Comparative Pilot Study.

This study evaluates the performance of four generative AI models--ChatGPT, DeepSeek, Gemini, and Copilot--in generating descriptive metadata for bibliographic resources. Models were tested on a small, diverse set of resources using four prompt types: a basic prompt, a basic prompt with an example,...

Descripción completa

Detalles Bibliográficos
Publicado en:Information Technology & Libraries Vol. 45; no. 2; pp. 1 - 21
Autores principales: Heng, Greta, Lampron, Patricia, Han, Myung-Ja
Formato: computer program research tables/charts Journal Article
Publicado: American Library Association Jun2026
Acceso en línea:Ver este registro en EBSCOhost
Descripción
Sumario:This study evaluates the performance of four generative AI models--ChatGPT, DeepSeek, Gemini, and Copilot--in generating descriptive metadata for bibliographic resources. Models were tested on a small, diverse set of resources using four prompt types: a basic prompt, a basic prompt with an example, a detailed prompt referencing Resource Description and Access (RDA) guidelines, and a detailed prompt with an example. Results show that both detailed RDA guidance and the inclusion of sample outputs improved metadata quality, particularly in formatting and field structure. While DeepSeek and ChatGPT showed better performance on the tasks, all models displayed limitations in parsing and following the prompts, using descriptive metadata fields, analyzing subject headings, and assigning URIs. These findings suggest that while generative AI holds potential to assist in metadata creation, its current capabilities fall short of meeting cataloging standards without human review.