02 JAN 2011 by ideonexus
Information Retrieval is an Arms Race Between Algorithms ...
IR is the focus for an arms race between algorithms to extract information from repositories as those repositories get larger and more complex, and users' demands get harder to satisfy (either in terms of response time or complexity of query). One obvious issue with respect to IR over the Web is that the Web has no QA authority. Anyone with an ISP account can place a page on the Web, and as is well known the Web has been the site of a proliferation of conspiracy theories, urban legends, tr...As the web gets larger and data grows more complex, less trustworthy in many regards, algorithms will need to grow more sophisticated to adapt to it.