sitemap.qa
robots.txt

Robots Exclusion Standard data for sitemap.qa

Resource Scan

Scan Details

Site Domain sitemap.qa
Base Domain sitemap.qa
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-26T10:36:30+00:00
Next Scan 2025-05-10T10:36:30+00:00

Last Successful Scan

Scanned2025-03-19T08:40:09+00:00
URL https://sitemap.qa/robots.txt
Redirect https://www.sitemap.qa/robots.txt
Redirect Domain www.sitemap.qa
Redirect Base sitemap.qa
Domain IPs 104.21.60.80, 172.67.194.59, 2606:4700:3036::ac43:c23b, 2606:4700:3037::6815:3c50
Redirect IPs 104.21.60.80, 172.67.194.59, 2606:4700:3036::ac43:c23b, 2606:4700:3037::6815:3c50
Response IP 104.21.60.80
Found Yes
Hash a0559c19370099665a97800733b327a418044eee99cb76c649df728efaf5014c
SimHash 65489c54c5b1

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://www.sitemap.qa/sitemap.xml