Every search engine, including Google, crawls and indexes your website content for inclusion into their search results. The bot is the script that scans your website for new content in order to index your web page.
What is crawling? What is a bot?
Custom Excerpt