Google is designed to be a scalable search engine.
The primary aim is to offer high quality search results over a rapidly rising World Wide Web. Google employs numerous strategies to improve search high quality together with page rank, anchor textual content, and proximity information. Furthermore, Google is a complete structure for gathering web pages, indexing them, and performing search queries over them.
A big-scale internet search engine is a complex system and much remains to be accomplished. Our fast objectives are to enhance search effectivity and to scale to roughly one hundred million net pages. Some easy improvements to effectivity embody question caching, smart disk allocation, and subindices.
Another space which requires much analysis is updates. We should have smart algorithms to decide what old web pages ought to be recrawled and what new ones ought to be crawled. One promising area of analysis is using proxy caches to construct search databases, since they are demand pushed.
We are planning to add simple features supported by industrial engines like google like boolean operators, negation, and stemming.