Decoding AI authorship: can LLMs truly mimic human style across literature and politics?
Amidst the rising capabilities of generative AI to mimic specific human styles, this study investigates the ability of state-of-the-art large language models (LLMs), including GPT-4o, Gemini 1.5 Pro, and Claude Sonnet 3.5, to emulate the authorial signatures of prominent literary and political figur...
| Published in: | Digital Scholarship in the Humanities Vol. 41; no. 2; pp. 594 - 613 |
|---|---|
| Main Author: | |
| Format: | Article |
| Published: |
Oxford University Press / USA
Jun2026
|
| Subjects: | |
| Online Access: | View this record in EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=194636959&site=ehost-live header: @attributes: shortDbName: hlh uiTerm: 194636959 longDbName: Humanities International Complete uiTag: AN controlInfo: bkinfo: jinfo: jid: 2055768X JEO9 jtl: Digital Scholarship in the Humanities issn: 2055768X maglogo: N pubinfo: dt: Jun2026 vid: 41 iid: 2 pid: 622 pub: Oxford University Press / USA artinfo: ui: 194636959 10.1093/llc/fqag040 ppf: 594 ppct: 19 formats: tig: atl: Decoding AI authorship: can LLMs truly mimic human style across literature and politics? aug: au: Alsadhan, Nasser A affil: College of Computer and Information Sciences, King Saud University, Riyadh 12372, Saudi Arabia su: Attribution of authorship Stylometry Language models Politicians Obama, Barack, 1961- Content analysis Classification algorithms Whitman, Walt, 1819-1892 Literary style Trump, Donald, 1946- Artificial intelligence Wordsworth, William, 1770-1850 sug: subj: Attribution of authorship Stylometry Language models Politicians Obama, Barack, 1961- Content analysis Classification algorithms Whitman, Walt, 1819-1892 Literary style Trump, Donald, 1946- Artificial intelligence Wordsworth, William, 1770-1850 ab: Amidst the rising capabilities of generative AI to mimic specific human styles, this study investigates the ability of state-of-the-art large language models (LLMs), including GPT-4o, Gemini 1.5 Pro, and Claude Sonnet 3.5, to emulate the authorial signatures of prominent literary and political figures: Walt Whitman, William Wordsworth, Donald Trump, and Barack Obama. Utilizing a zero-shot prompting framework with strict thematic alignment, we generated synthetic corpora evaluated through a complementary framework combining transformer-based classification (BERT) and feature-based machine learning (XGBoost). Our methodology integrates Linguistic Inquiry and Word Count (LIWC) markers, perplexity, and readability indices to assess divergence between AI-generated and human-authored text. Results demonstrate that AI-generated mimicry remains highly detectable, with XGBoost models trained on a restricted set of eight stylometric features achieving accuracy comparable to high-dimensional neural classifiers. Post-hoc feature importance analysis indicates that perplexity is the most influential discriminative metric, suggesting systematic differences in the distributional regularity of AI outputs relative to the greater variability observed in human writing. While LLMs exhibit distributional convergence with human authors on low-dimensional heuristic features, such as syntactic complexity and readability, they do not yet fully replicate the nuanced affective density and stylistic variance inherent in the human-authored corpus. By isolating measurable statistical divergences in current generative mimicry, this study provides a structured benchmark for LLM stylistic behavior and offers insights for authorship attribution in digital humanities and social media contexts. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: Y dt: @attributes: year: 2026 holdings: @attributes: islocal: N |
|---|