sitemap.download

CRAWLING AND LIMITS

Can this tool include PDFs or other non-HTML files?

This crawler accepts HTML pages and skips common non-page extensions such as PDF, ZIP and media files. It is not a general file inventory tool.

A website may have public resources beyond the pages this tool can discover. Compare the results with your own inventory if those resources matter, and use a suitable sitemap workflow for the content types you need.

← Search all 59 questions