Overview
Find every record in two noisy sources (10 million records) that belongs to each of 1.7 million businesses, across the US, India and France, a country the model never saw in training. Team Legacy finished 526th of about 8,500 teams with a final score of 0.985.
What it does
- Cuts each search to about 5 candidates and keeps 99.2% of true matches
- Scores pairs with a fine-tuned multilingual cross-encoder and LightGBM
- Built over 20 measured versions, each checked on an untouched holdout
Built with
Problems we faced
- A country with no training data. France only appeared in the test set. Name features built from word classes let patterns learned on US and Indian names carry over.
- Look-alike businesses. Sister companies at the same address, differing by one word or a neighbouring house number, had to be told apart from true copies.
- Records with no address. Many shared a name with several businesses, so picking the right owner needed name-frequency features.
- Compute. The full pipeline needs a GPU and about 250 GB of RAM. One version was lost with its cloud machine before it could be submitted.
