CRAWLING AND LIMITS
Can this tool include PDFs or other non-HTML files?
This crawler accepts HTML pages and skips common non-page extensions such as PDF, ZIP and media files. It is not a general file inventory tool.
A website may have public resources beyond the pages this tool can discover. Compare the results with your own inventory if those resources matter, and use a suitable sitemap workflow for the content types you need.