Program which crawls the web and fetches web pages in order for them to be indexed against keywords. Used by search engines to formulate search result pages.