Can I crawl password-protected pages?

No authenticated crawl is provided. The proxy does not forward your browser login cookies or authorization headers to the target. A page visible in your signed-in browser may therefore return a login page or an error to the crawler.

Use this tool for public content you own or are authorized to crawl. Do not place a password or token in the URL to work around the restriction. Protect confidential pages with proper access controls.