news.ycombinator.com
Techniques for matching similar/identical products from different stores?https://news.ycombinator.com/item?id=6667144I’m trying to write a simple program to compare prices for products from different suppliers.Different suppliers may call the same product different things.For example, the following three strings refer to the same product:A2 Full Cream Milk Bottle 2l A2 Milk Full Cream 2L A2 Full Cream Milk 2LOr the following two strings are the same product:Ambi Pur Air Freshener Car Voyage 8mL. Fresh Vanilla Flower fragrance. - 1 each Ambi Pur Air Freshener Voyage Primary 8mlFurthermore - some products are not the same, but are similar (for example, Full Cream 2L Milk may encompass various similar products.)What are currently recommended techniques for matching product strings like this?From my Googling, I found:1. Some people recommend using Bayesian filtering techniques. 2. Some recommend doing feature extraction on all the products strings. So you might extract things like brands (e.g. “A2”), Product (“Milk”) and capacity (“2L”) from the products, then create distance vectors between products, anNov 4, 2013 6:14 AM