The Anatomy of a Real-Time Search Engine

Normal search engines use batch processes to swipe the web, parse pages and index their content. In the fast paced real-time web, created through the links shared by millions of people everywhere, that is a luxury that we can not afford. In this talk I describe some of the technologies that we used at OneRiot to build a fast real-time search engine.