SEO & Bot Behavior

How search engines are crawling your site

Crawl frequency

Status codes served to bots

Most-crawled vs. most-visited URLs