Visualizing the document pre-processing effects in text mining process
dc.contributor.author | Eler, Danilo Medeiros [UNESP] | |
dc.contributor.author | Pola, Ives Renê Venturini [UNESP] | |
dc.contributor.author | Garcia, Rogério Eduardo [UNESP] | |
dc.contributor.author | Teixeira, Jaqueline Batista Martins [UNESP] | |
dc.contributor.institution | Universidade Estadual Paulista (Unesp) | |
dc.date.accessioned | 2018-12-11T17:19:35Z | |
dc.date.available | 2018-12-11T17:19:35Z | |
dc.date.issued | 2018-01-01 | |
dc.description.abstract | Text mining is an important step to categorize textual data by using data mining techniques. As most obtained textual data is unstructured, it needs to be processed before applying mining algorithms – that process is known as pre-processing step in overall text mining process. Pre-processing step has important impact on mining. This paper aims at providing detailed analysis of the document pre-processing when employing multidimensional projection techniques to generate graphical representations of vector space models, which are computed from eight combinations of three steps: stemming, term weighting and term elimination based on low frequency cut. Experiments were made to show that the visual approach is useful to perceive the processing effects on document similarities and group formation (i.e., cohesion and separation). Additionally, quality measures were computed from graphical representations and compared with classification rates of a k-Nearest Neighbor and Naive Bayes classifiers, where the results highlights the importance of the pre-processing step in text mining. | en |
dc.description.affiliation | Faculdade de Ciências e Tecnologia Departamento de Matemática e Computação UNESP – Universidade Estadual Paulista | |
dc.description.affiliationUnesp | Faculdade de Ciências e Tecnologia Departamento de Matemática e Computação UNESP – Universidade Estadual Paulista | |
dc.description.sponsorship | Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP) | |
dc.description.sponsorshipId | FAPESP: # 2013/03452-0 | |
dc.format.extent | 485-491 | |
dc.identifier | http://dx.doi.org/10.1007/978-3-319-54978-1_62 | |
dc.identifier.citation | Advances in Intelligent Systems and Computing, v. 558, p. 485-491. | |
dc.identifier.doi | 10.1007/978-3-319-54978-1_62 | |
dc.identifier.issn | 2194-5357 | |
dc.identifier.lattes | 8031012573259361 | |
dc.identifier.orcid | 0000-0003-1248-528X | |
dc.identifier.scopus | 2-s2.0-85045731840 | |
dc.identifier.uri | http://hdl.handle.net/11449/176206 | |
dc.language.iso | eng | |
dc.relation.ispartof | Advances in Intelligent Systems and Computing | |
dc.rights.accessRights | Acesso aberto | |
dc.source | Scopus | |
dc.subject | Document pre-processing | |
dc.subject | Document similarity | |
dc.subject | Multidimensional projection | |
dc.subject | Text mining | |
dc.subject | Visualization | |
dc.title | Visualizing the document pre-processing effects in text mining process | en |
dc.type | Trabalho apresentado em evento | |
unesp.author.lattes | 8031012573259361[3] | |
unesp.author.orcid | 0000-0003-1248-528X[3] | |
unesp.department | Matemática e Computação - FCT | pt |