sitemap.download

ERRORS AND TROUBLESHOOTING

What should I do after “Too many requests”?

Wait at least a minute before starting another run. Multiple tabs or visitors sharing a connection may share the service’s rate limit. The target website can also impose its own limits. This tool fetches pages sequentially with a pause; increasing the page limit does not increase request concurrency.

Avoid opening several parallel crawl tabs to try to get around a limit. Save available results and return after the service or target website is ready to accept requests again.

← Search all 59 questions