Crawling

The process of a search engine spider (or bot) working its way through a website (or the entire web) to discover new or updated content for indexing.