1) Spider : It finds out new pages introduced and submits to the database
2) Indexer: Parses the content of the page and categorizes according to its importance like hyperlinks, bold and italic content, heading, Title, URL
3) Crawler: A semantic algorithm to find relevancy of an indexed page based upon its keyword frequency and proximity.