Ngram and Bayesian Classification of Documents for Topic and Authorship.

Large, real world, data sets have been investigated in the context of Authorship Attribution of real world documents. Ngram measures can be used to accurately assign authorship for long documents such as novels. A number of 5 (authors &times 5 (movies) arrays of movie reviews were acquired from the...

Descripción completa

Detalles Bibliográficos
Publicado en:Literary & Linguistic Computing Vol. 18; no. 4; pp. 423 - 448
Autores principales: Clement, Ross, Sharp, David
Formato: Artículo
Publicado: Oxford University Press / USA Nov2003
Materias:
Acceso en línea:Ver este registro en EBSCOhost
Descripción
Sumario:Large, real world, data sets have been investigated in the context of Authorship Attribution of real world documents. Ngram measures can be used to accurately assign authorship for long documents such as novels. A number of 5 (authors &times 5 (movies) arrays of movie reviews were acquired from the Internet Movie Database. Both ngram and naive Bayes classifiers were used to classify along both the authorship and topic (movie) axes. Both approaches yielded similar results, and authorship was as accurately detected, or more accurately detected, than topic. Part of speech tagging and function-word lists were used to investigate the influence of structure on classification tasks on documents with meaning removed but grammatical structure intact.