Why are some pages missing?

The crawler can only follow HTML links reachable from the start URL on the same origin. Unlinked pages, pages behind login and links generated only by scripts can be missed. Check the live URL feed for failed requests, and compare the output with your content inventory. Add normal internal links where appropriate; this tool cannot guarantee complete discovery.

An XML sitemap cannot restore pages the crawler never found. For important omissions, inspect the source HTML, make sure the page is public and verify that its links use the same protocol and hostname as the crawl origin.