What if my website blocks the crawler’s requests?

Security systems may reject automated requests from the proxy even when a normal browser can access the same page. The feed may show an HTTP 403, a challenge page or another unexpected response.

If you own the target, inspect its security rules and determine whether a narrowly scoped exception is appropriate. Do not broadly disable protections just to obtain a sitemap. Your platform’s own sitemap export may be the simpler approach.