Software used by a search engine to find and retrieve web pages to include in its database (also called index).
