foundation.mozilla.org
robots.txt
Robots Exclusion Standard data for foundation.mozilla.org
Resource Scan
Scan Details
Site Domain | foundation.mozilla.org |
Base Domain | mozilla.org |
Scan Status | Ok |
Last Scan | 2024-05-17T11:58:44+00:00 |
Next Scan | 2024-06-16T11:58:44+00:00 |
Last Scan
Scanned | 2024-05-17T11:58:44+00:00 |
URL | https://foundation.mozilla.org/robots.txt |
Domain IPs | 104.26.4.133, 104.26.5.133, 172.67.74.128, 2606:4700:20::681a:485, 2606:4700:20::681a:585, 2606:4700:20::ac43:4a80 |
Response IP | 172.67.74.128 |
Found | Yes |
Hash | 4ff359a55b488e6ed46c6de62776b1bbd77d669d1c532e56d12458f6205604c2 |
SimHash | 4828d880e332 |
Groups
*
Rule | Path |
---|---|
Disallow | /*/artifacts/thimble |
Disallow | /artifacts/thimble |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |