Shallow parsing
Shallow parsing (also chunking, "light parsing") is an analysis of a sentence which identifies the constituents (noun groups, verbs, verb groups, etc.), but does not specify their internal structure, nor their role in the main sentence.
It is a technique widely used in natural language processing. It is similar to the concept of lexical analysis for computer languages. Under the name of the Shallow Structure Hypothesis, it is also used as an explanation for why second language learners often fail to parse sentences that are complex correctly.[1]
References
- ↑ Clahsen, Felser, Harald, Claudia (2006). "Grammatical Processing in Language Learners". Applied Psycholinguistics 27, p. 3-42. doi:10.1017/S0142716406060024.
- Illinois Shallow Parser Shallow Parser Demo
- Apache OpenNLP includes a chunker.
- GATE General Architecture for Text Engineering includes a chunker.
External links
- NP Chunking (State of the art)
- Abney, Steven (1991), Parsing By Chunks (PDF), Kluwer Academic Publishers, pp. 257–278.
- Clahsen, Harald, and Claudia Felser. (2006). Grammatical processing in language learners. Applied Psycholinguistics 27, p. 3-42.
See also
- Parser
| ||||||||||||||||||||||||||||||||||