On Sep 15, 2010, at 10:40 PM, Andreas wrote:
> I need to clean up a lot of contact data because of a merge of customer lists that used to be kept separate.
> I allready know that there are double entries within the lists and they do overlap, too.
>
> Relevant fields could be name, street, zip, city, phone
>
> Is there a way to do something like this with postgresql ?
>
> I fear this will need still a lot of manual sorting and searching even when potential peers get automatically
identified.
I recently started working with the pg_trgm contrib module for matching songs based on titles and writers. This is
especiallydifficult because the writer credits end up in one big field with every possible variation on order and
namingconventions. So far I have been pleased with the results. For example, the algorithm correctly matched these two
songtitles:
FONTAINE DI ROMA AKA FOUNTAINS OF ROME
FOUNTAINS OF ROME A/K/A FONTANE DI ROMA
Trigrams can be indexed, so it is relatively fast to find an initial set of candidates.
There is a nice introductory article here:
http://www.postgresonline.com/journal/categories/59-pgtrgm
John DeSoi, Ph.D.