In May 2000 I wrote A few thoughts about the future of Internet Information Retrieval (i.e., search), and ten years later tried to evaluate how those predictions actually held up — with the original prediction in italics followed by the evaluation.

1. Specialized Services Within Search

1a) Prediction (May 2000)

It seems likely that the specialization in the Internet Information Retrieval (IIR) business will continue. Internet information crawling, pre-processing, indexing, searching and presentation requires different types of technologies and know-how, this might create opportunities for new companies specializing in only one step of the IIR "food chain". One possibility could be that companies doing crawling will offer extracts of relevant data on request, e.g. a search engine specializing in winter sports could get only relevant data extracted from several regional crawler companies. In other words, the IIR "food chain" might increase in length.

1b) Evaluation (May 2010)

Specialization of search services happened to some degree, though with relatively small impact. Examples include fetching/crawl-related services (such as 80legs).

The services with the biggest impact, however, are free APIs (such as the Google AJAX Search API and Bing APIs) and commercial search APIs (such as Yahoo BOSS and the Wolfram Alpha API) — all sharing the pattern of offering the final step (search), thereby implicitly covering every step behind it. Also noteworthy is the rise of cloud computing and large public datasets such as Infochimps, DBpedia, and the Public Terabyte crawl dataset.

2. Potential New Search Players

2a) Prediction (May 2000)

As the importance of Internet Information Retrieval grows, players that have been concentrating on the lower end of the Internet "food chain", i.e. major bandwidth providers (e.g. MCI or British Telecom) and network software/hardware vendors (e.g. 3COM or Cisco) might want to enter the market as providers of partially indexed data to search engines and topic hierarchies.

2b) Evaluation (May 2010)

This didn't happen at all to my knowledge.

3. Potential New Search Technologies

3a) Prediction (May 2000)

With the increased growth of the amount of data on the Internet, new technologies for doing distributed indexing/search of data will probably occur. This is particularly interesting if processing and indexing of multimedia data (e.g. sound, pictures and video) becomes popular. Processing of multimedia data is considerably more CPU intensive than processing of textual data. Example of such processing could be automatic detection of objects (e.g. a car) in video frames.

3b) Evaluation (May 2010)

Massively distributed indexing in a "SETI@home-style" didn't happen at large scale, though a few projects pursued distributed crawling/indexing (e.g. the Majestic project). Meanwhile, the processing of multimedia data is indeed happening — though it remains far from a trivial problem to solve.

Conclusion

If I am kind — 0.5 on prediction 1, 0 on prediction 2, and 0.5 on prediction 3 — ~33.33% correct?