Software robots that "crawl" Web pages, gathering information for search engine databases. Also known as search engine crawlers.

are automated programs (sometimes called a webcrawler) which crawls over the World Wide Web, gathering web pages for search engines. Large search engines employ many spiders. Spiders are a type of robot.

Search Engines use special programs, called Spiders or Robots that catalogue web sites for use in their searches.

Software robots that "crawl" Web pages, reading text and following links to gather information for search engine databases.

The automated internet searching 'robots' used by search engines such as Google or Yahoo.

The robots that are sent out by search engines to ‘crawl’ through your website gathering data

Spiders or crawlers are actually software that is sent out by the search engine to find all of the content in the site, following html text links.