yari-demos.prod.mdn.mozit.cloud
robots.txt

Robots Exclusion Standard data for yari-demos.prod.mdn.mozit.cloud

Resource Scan

Scan Details

Site Domain yari-demos.prod.mdn.mozit.cloud
Base Domain mozit.cloud
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-04-28T11:47:57+00:00
Next Scan 2025-05-12T11:47:57+00:00

Last Successful Scan

Scanned2025-03-21T11:46:56+00:00
URL https://yari-demos.prod.mdn.mozit.cloud/robots.txt
Redirect https://developer.mozilla.org/robots.txt
Redirect Domain developer.mozilla.org
Redirect Base mozilla.org
Domain IPs 2600:1901:0:c197::, 35.190.14.201
Redirect IPs 2600:1901:0:ab4c::, 34.111.97.67
Response IP 34.111.97.67
Found Yes
Hash 8f2712e11105e549aa4fa1ea4de6a9fd5292ee805d773d669ca98a9e0e54273a
SimHash 6d145c544c93

Groups

*

Rule Path
Disallow /api/
Disallow /*/files/
Disallow /media

Other Records

Field Value
sitemap https://developer.mozilla.org/sitemap.xml