america.aljazeera.com
robots.txt

Robots Exclusion Standard data for america.aljazeera.com

Resource Scan

Scan Details

Site Domain america.aljazeera.com
Base Domain aljazeera.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-04-09T01:41:46+00:00
Next Scan 2024-06-08T01:41:46+00:00

Last Successful Scan

Scanned2024-01-18T00:56:19+00:00
URL http://america.aljazeera.com/robots.txt
Domain IPs 184.51.97.97, 2600:1413:b000:693::2392, 2600:1413:b000:695::2392
Response IP 23.199.81.83
Found Yes
Hash 199ed09450a8e74c5322f2d2ee904b54a4a50471078f43b28c2f97e5f310698f
SimHash 68054c54cd93

Groups

*

Rule Path
Disallow /projects/

Other Records

Field Value
sitemap http://america.aljazeera.com/sitemap.xml