Skip to main content

Posts

Showing posts from November, 2018

ESS - 3.Tools and Technologies involved in modern search architecture - Part I

How Search works? It's amazing how much processing is done behind the scenes of a single search. Here are four crucial tools that form the core of  search processing: Web Crawler (Spiders) Indexing (Inverted Index) Relevance score SERP (Search Engine Results Page) When you make a search in google, yahoo, bing or any popular search engine. The process doesn't involve running a marathon through entire documents present in world wide web. As it becomes heavily complex for every search and increase in data over time so instead every search engine has an index which is simply a lookup database to quickly find the relevant information when say quick they mean it. Google claims it's search results will be delivered in less than 1/2 a second 💪 Web Crawler: - Web crawlers are those little software spiders that goes and indexes all the content following links within one document to another. These web crawlers do their job continuously as the new content gets a...