Development of aggregator prices

For larger portal needs to develop an additional section aggregator of prices for goods in the industry. The problem is that the number of positions that will need to compare/sample, can be from 5 to 200 million Respectively, each With