sitemap.download

CRAWLING AND LIMITS

Can I restrict a crawl to a single folder?

There is no folder-only setting in this version. Starting from a folder URL changes the first page but does not restrict later links to that path.

The crawler follows same-origin HTML links, so navigation can lead outside the starting folder. Use the review list to exclude unwanted pages from the export. This changes the download, not which pages were already requested during the crawl.

← Search all 59 questions