Document classification
From Wikipedia, the free encyclopedia
Document classification/categorization is a problem in information science. The task is to assign an electronic document to one or more categories, based on its contents. Document classification tasks can be divided into two sorts: supervised document classification where some external mechanism (such as human feedback) provides information on the correct classification for documents, and unsupervised document classification, where the classification must be done entirely without reference to external information. There is also a semi-supervised document classification, where parts of the documents are labeled by the external mechanism.
Contents |
[edit] Techniques
Document classification techniques include:
- naive Bayes classifier
- tf-idf
- latent semantic indexing
- support vector machines
- artificial neural network
- kNN
- decision trees, such as ID3
- Concept Mining
and approaches based on natural language processing.
[edit] Applications
Classification techniques have been applied to spam filtering, a process which tries to discern E-mail spam messages from legitimate emails.
[edit] See also
- classification
- supervised learning, unsupervised learning
- document retrieval
- information retrieval
- string metrics
- machine learning
- text mining, web mining, concept mining
[edit] Further reading
Publications:
- Fabrizio Sebastiani. Machine learning in automated text categorization. ACM Computing Surveys, 34(1):1–47, 2002 [1]
- Introduction to document classification
- Bibliography on Automated Text Categorization
- Bibliography on Query Classification
Data sets:
