sitemap.download

ERRORS AND TROUBLESHOOTING

Why does the crawl stop when the first page fails?

The first successful page establishes the crawl origin and supplies the first links. If it cannot be fetched, there is no reliable starting point for exploring that website.

Check the full address and try the final public URL after any redirects. The feed can help distinguish an HTTP error, timeout, unsupported content type or rejected destination. Starting several runs in quick succession is unlikely to fix a blocked target.

← Search all 59 questions