AbstractsComputer Science

A text mining framework in R and its applications

by Ingo Feinerer

Institution: Vienna University of Economics and Business
Year: 2008
Keywords: RVK ST 304, ST 600; text mining / R <program> / framework / infrastructure /
Record ID: 1031771
Full text PDF: http://epub.wu.ac.at/1923/1/document.pdf


Text mining has become an established discipline both in research as in business intelligence. However, many existing text mining toolkits lack easy extensibility and provide only poor support for interacting with statistical computing environments. Therefore we propose a text mining framework for the statistical computing environment R which provides intelligent methods for corpora handling, meta data management, preprocessing, operations on documents, and data export. We present how well established text mining techniques can be applied in our framework and show how common text mining tasks can be performed utilizing our infrastructure. The second part in this thesis is dedicated to a set of realistic applications using our framework. The first application deals with the implementation of a sophisticated mailing list analysis, whereas the second example identifies the potential of text mining methods for business to consumer electronic commerce. The third application shows the benefits of text mining for law documents. Finally we present an application which deals with authorship attribution on the famous Wizard of Oz book series. (author's abstract)