Regex misspellings

Question

I have a regex created from a list in a database to match names for types of buildings in a game. The problem is typos, sometimes those writing instructions for their team in the game will misspell a building name and obviously the regex will then not pick it up (i.e. spelling "University" and "Unversity").

Are there any suggestions on making a regex match misspellings of 1 or 2 letters?

The regex is dynamically generated and run on a local machine that's able to handle a lot more load so I have as a last resort to algorithmically create versions of each word with a letter missing and then another with letters added in.

I'm using PHP but I'd hope that any solution to this issue would not be PHP specific.

Answer 1

Allow me to introduce you to the Levenshtein Distance, a measure of the difference between strings as the number of transformations needed to convert one string to the other.

It's also built into PHP.

So, I'd split the input file by non-word characters, and measure the distance between each word and your target list of buildings. If the distance is below some threshold, assume it was a misspelling.

I think you'd have more luck matching this way than trying to craft regex's for each special case.

Answer 2

Google's implementation of "did you mean" by looking at previous results might also help:

How do you implement a "Did you mean"?

Answer 3

What is Soundex() ? – Teifion (28 mins ago)

A soundex is similar to the levenshtein function Triptych mentions. It is a means of comparing strings. See: http://us3.php.net/soundex

You could also look at metaphone and similar_text. I would have put this in a comment but I don't have enough rep yet to do that. :D

Answer 4

Back in the days we sometimes used Soundex() for these problems.