Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

stanford Core NLP: Splitting sentences from text

I am new to stanford Core NLP. I would like to use it for splitting sentences from text in English, German,French. Which class does this work?Thanks in advance.

like image 372
thetna Avatar asked Sep 10 '12 17:09

thetna


People also ask

What is sentence splitter in NLP?

Description. Sentence splitting is the process of dividing text into sentences. For instance the document Hello world. Hello world again.

How to split sentences?

For splitting sentences first mark the clauses. Then make sub-clauses independent by omitting subordinating linkers and inserting subjects or other words wherever necessary. Example – When I went to Delhi I met my friend who lives there. Clause 1 (When) I went to Delhi.

How do you split a phrase in Python?

The simplest approach provided by Python to convert the given list of Sentences into words with separate indices is to use split() method. This method split a string into a list where each word is a list item.


1 Answers

For the lower level classes that handle this, you can look at the tokenizer documentation. At the CoreNLP level, you can just use the Annotator's "tokenize,ssplit".

like image 91
Christopher Manning Avatar answered Sep 24 '22 11:09

Christopher Manning