Are URL fragments such as #contact included?

The generator removes the fragment part of discovered URLs before deduplication. A link to /about#contact and one to /about#team therefore resolve to the same crawl URL.

This avoids treating in-page anchors as separate pages. Applications that use fragments to create virtual screens are not rendered by this crawler, so it cannot turn those screens into independent HTML page entries.