Performance and biases of Large Language Models in public opinion simulation.
The rise of Large Language Models (LLMs) like ChatGPT marks a pivotal advancement in artificial intelligence, reshaping the landscape of data analysis and processing. By simulating public opinion, ChatGPT shows promise in facilitating public policy development. However, challenges persist regarding...
| Publicado en: | Humanities & Social Sciences Communications Vol. 11; no. 1; pp. 1 - 14 |
|---|---|
| Autores principales: | , |
| Formato: | Artículo |
| Publicado: |
Springer Nature
8/28/2024
|
| Materias: | |
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=179295811&site=ehost-live header: @attributes: shortDbName: hlh uiTerm: 179295811 longDbName: Humanities International Complete uiTag: AN controlInfo: bkinfo: jinfo: jid: MVR0 jtl: Humanities & Social Sciences Communications maglogo: N pubinfo: dt: 8/28/2024 vid: 11 iid: 1 pid: 237 pub: Springer Nature artinfo: ui: 179295811 10.1057/s41599-024-03609-x ppf: 1 ppct: 13 formats: tig: atl: Performance and biases of Large Language Models in public opinion simulation. aug: au: Qu, Yao Wang, Jue affil: https://ror.org/02e7b5302 School of Social Sciences, Nanyang Technological University, Singapore, Singapore su: Language models Public opinion Social classes Public opinion polls ChatGPT Artificial intelligence Ethnicity United States sug: subj: United States Language models Public opinion Social classes Public opinion polls ChatGPT Artificial intelligence Ethnicity ab: The rise of Large Language Models (LLMs) like ChatGPT marks a pivotal advancement in artificial intelligence, reshaping the landscape of data analysis and processing. By simulating public opinion, ChatGPT shows promise in facilitating public policy development. However, challenges persist regarding its worldwide applicability and bias across demographics and themes. Our research employs socio-demographic data from the World Values Survey to evaluate ChatGPT's performance in diverse contexts. Findings indicate significant performance disparities, especially when comparing countries. Models perform better in Western, English-speaking, and developed nations, notably the United States, in comparison to others. Disparities also manifest across demographic groups, showing biases related to gender, ethnicity, age, education, and social class. The study further uncovers thematic biases in political and environmental simulations. These results highlight the need to enhance LLMs' representativeness and address biases, ensuring their equitable and effective integration into public opinion research alongside conventional methodologies. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: Y dt: @attributes: year: 2024 holdings: @attributes: islocal: N |
|---|