Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

regex: getting backreference to number, adding to it

Simple regex question:

I want to replace page numbers in a string with pagenumber + some number (say, 10). I figured I could capture a matched page number with a backreference, do an operation on it and use it as the replacement argument in re.sub.

This works (just passing the value):

def add_pages(x):
    return x

re.sub("(?<=Page )(\d{2})",add_pages(r"\1") ,'here is Page 11 and here is Page 78\nthen there is Page 65',re.MULTILINE)

Yielding, of course, 'here is Page 11 and here is Page 78\nthen there is Page 65'

Now, if I change the add_pages function to modify the passed backreference, I get an error.

def add_pages(x):
        return int(x)+10


re.sub("(?<=Page )(\d{2})",add_pages(r"\1") ,'here is Page 11 and here is Page 78\nthen there is Page 65',re.MULTILINE)

ValueError: invalid literal for int() with base 10: '\\1'

, as what is passed to the add_pages function seems to be the literal backreference, not what it references.

Absent extracting all matched numbers to a list and then processing and adding back, how would I do this?

like image 243
ako Avatar asked Nov 26 '14 07:11

ako


People also ask

What does this mean in regex ([ ])\ 1?

The backreference \1 (backslash one) references the first capturing group. \1 matches the exact same text that was matched by the first capturing group. The / before it is a literal character.

What is back reference in regular expression?

back-references are regular expression commands which refer to a previous part of the matched regular expression. Back-references are specified with backslash and a single digit (e.g. ' \1 '). The part of the regular expression they refer to is called a subexpression, and is designated with parentheses.

Is re built in Python?

Python has a built-in package called re , which can be used to work with Regular Expressions.


1 Answers

The actual problem is, you are supposed to pass a function to the second parameter of re.sub, instead you are calling a function and passing the return value.

Why does it work in the first case?

Whenever a match is found, the second parameter will be looked at. If it is a string, then it will be used as the replacement, if it is a function, then the function will be called with the match object. In your case, add_pages(r"\1"), is simply returning r"\1" itself. So, the re.sub translates to this

print re.sub("(?<=Page )(\d{2})", r"\1", ...)

So, it actually replaces the original matched string with the same. That is why it works.

Why it doesn't work in the second case?

But, in the second case, when you do

add_pages(r"\1")

you are trying to convert r"\1" to an integer, which is not possible. That is why it is failing.

How to fix this?

The actual way to write this would be,

def add_pages(matchObject):
    return str(int(matchObject.group()) + 10)
print re.sub("(?<=Page )(\d{2})", add_pages, ...)

Read more about the group function, here

like image 54
thefourtheye Avatar answered Oct 07 '22 22:10

thefourtheye