Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to perform Paragraph boundary detection in NLP frameworks?

I am working on extracting names of people from various ads appearing in English newspapers .

However , i have noticed that I need to identify the boundary of an Ad , before extracting the names present in it ,since I need only the first occurring name to be extracted .I started with Stanford NLP . I was successful in extracting names . But I got stuck in identifying the paragraph boundary.

Is there any way of identifying the paragraph boundary . ?

like image 270
kiran Avatar asked Oct 02 '22 09:10

kiran


1 Answers

This is a difficult problem, we are facing the same problem in one of our projects. There are some theory papers out there which help define the scope of the problem and potential solutions in detail. I'll include them below.

We're still in the process of R&D so we haven't many answers just yet, but we are willing to share what we have and find as time moves forward.

Here is one such paper:

Automatic Paragraph Identification: A Study across Languages and Domains

Here is the github link for the ISCIBoost Code they use:

Open-source implementation of Boostexter (Adaboost based classifier)

like image 166
ProfVersaggi Avatar answered Oct 08 '22 00:10

ProfVersaggi