Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Regex add character to matched string

Tags:

python

regex

nlp

I have a long string which is a paragraph, however there is no white space after periods. For example:

para = "I saw this film about 20 years ago and remember it as being particularly nasty. I believe it is based on a true incident: a young man breaks into a nurses\' home and rapes, tortures and kills various women.It is in black and white but saves the colour for one shocking shot.At the end the film seems to be trying to make some political statement but it just comes across as confused and obscene.Avoid."

I am trying to use re.sub to solve this problem, but the output is not what I expected.

This is what I did:

re.sub("(?<=\.).", " \1", para)

I am matching the first char of each sentence, and I want to put a white space before it. My match pattern is (?<=\.)., which (supposedly) checks for any character that appears after a period. I learned from other stackoverflow questions that \1 matches the last matched pattern, so I wrote my replace pattern as \1, a space followed by the previously matched string.

Here is the output:

"I saw this film about 20 years ago and remember it as being particularly nasty. \x01I believe it is based on a true incident: a young man breaks into a nurses\' home and rapes, tortures and kills various women. \x01t is in black and white but saves the colour for one shocking shot. \x01t the end the film seems to be trying to make some political statement but it just comes across as confused and obscene. \x01void. \x01

Instead of matching any character preceded by a period and adding a space before it, re.sub replaced the matched character with \x01. Why? How do I add a character before a matched string?

like image 382
versatile parsley Avatar asked Mar 11 '17 06:03

versatile parsley


4 Answers

The (?<=a)b is a positive lookbehind. It matches b following a. The a is not captured. So in your expression, I'm not sure what the value of \1 represents in this case, but it's not what's inside of (?<=...).

Your current approach has another flaw: it would add a space after a . even when one is already there.

To add missing space after ., I suggest a different strategy: replace .-followed-by-non-space-non-dot with . and a space:

re.sub(r'\.(?=[^ .])', '. ', para)
like image 133
janos Avatar answered Oct 20 '22 04:10

janos


A slightly modified version of your regex will also work:

print re.sub(r"([\.])([^\s])", r"\1 \2", para)

# I saw this film about 20 years ago and remember it as being particularly nasty. I believe it is based on a true incident: a young man breaks into a nurses' home and rapes, tortures and kills various women. It is in black and white but saves the colour for one shocking shot. At the end the film seems to be trying to make some political statement but it just comes across as confused and obscene. Avoid.
like image 35
Sandipan Dey Avatar answered Oct 20 '22 04:10

Sandipan Dey


You may perhaps use the following regex (with a positive look-behind and negative look-ahead assertion):

(?<=\.)(?!\s)

python

re.sub(r"(?<=\.)(?!\s)", " ", para)

see demo

like image 27
m87 Avatar answered Oct 20 '22 02:10

m87


I think this is what you want to do. You can pass a function in to do the replacement.

import re

def my_replace(match):
    return " " + match.group()

my_string = "dhd.hd hd hs fjs.hello"
print(re.sub(r'(?<=\.).', my_replace, my_string))

Prints:

dhd. hd hd hs fjs. hello

As @Seanny123 pointed out, this will add a space even if there was already a space after the period.

like image 39
Millie Smith Avatar answered Oct 20 '22 04:10

Millie Smith