Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

What is a chunker in Natural Language Processing?

Tags:

nlp

chunking

Does anyone know what is a chunker in the context of text processing and what is it's usage?

like image 730
Hossein Avatar asked Jan 21 '11 10:01

Hossein


People also ask

What is a chunk phrase?

Phrase chunking is a phase of natural language processing that separates and segments a sentence into its subconstituents, such as noun, verb, and prepositional phrases, abbreviated as NP, VP, and PP, respectively. Typically, each subconstituent or chunk is denoted by brackets.

Why is chunking required?

Chunking allows people to take smaller bits of information and combine them into more meaningful, and therefore more memorable, wholes.

What is chunking in ner?

What is Chunking? Chunking, one of the important processes in natural language processing, is used to identify parts of speech (POS) and short phrases. In other simple words, with chunking, we can get the structure of the sentence. It is also called partial parsing.

What is chunking in NLTK?

chunk package. Classes and interfaces for identifying non-overlapping linguistic groups (such as base noun phrases) in unrestricted text. This task is called “chunk parsing” or “chunking”, and the identified groups are called “chunks”.


1 Answers

According to these slides, chunking is an alternative to parsing that provides a partial syntactic structure of a sentence, with a limited tree depth, as opposed to full on parsing.

It is more limited than full parsing, but is sufficient when it comes to extracting or ignoring information, and is thus many times used, as it's faster and more robust than parsing.

Much more information is available in the slides.

Further links:

  • More slides
  • Notes from lectures at NYU
like image 118
Sebastian Paaske Tørholm Avatar answered Oct 12 '22 10:10

Sebastian Paaske Tørholm