2

Is MapReduce the reason for the instant search results produced by google or is it just used to index the massive web page data ? I mean is MApreduce at work behind every search query that I enter ? I was confused because to my understanding there is a latency associated with running Hadoop so it can not be the tool used the seach the indexed data for a query.

1 Answer 1

2

MapReduce was used by Google until 2010 to build the search index. Your search query is fired against that index which then returns quick responses. The issue with MapReduce was, that the update frequency was too low to keep up with the updates of the web. Since 2010 Google uses Caffeine, which is based on BigTable. See also here and here.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.