bugzilla.mozilla.org
robots.txt
Robots Exclusion Standard data for bugzilla.mozilla.org
Resource Scan
Scan Details
Site Domain | bugzilla.mozilla.org |
Base Domain | mozilla.org |
Scan Status | Ok |
Last Scan | 2025-09-17T05:58:59+00:00 |
Next Scan | 2025-10-17T05:58:59+00:00 |
Last Scan
Scanned | 2025-09-17T05:58:59+00:00 |
URL | https://bugzilla.mozilla.org/robots.txt |
Domain IPs | 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91 |
Response IP | 151.101.193.91 |
Found | Yes |
Hash | 9ffdf1bb5f9a940a1f9569879ec4fc0b79e564543665272cc1e79895d12e02b7 |
SimHash | 43008c708610 |
Groups
*
Rule | Path |
---|---|
Disallow | / |
Allow | /$ |
Allow | /index.cgi |
Allow | /page.cgi |
Disallow | /page.cgi*id%3Dvoting* |
Disallow | /page.cgi*id%3Dproductdashboard* |
Disallow | /page.cgi*id%3Duser_activity* |
Allow | /show_bug.cgi |
Disallow | /show_bug.cgi*ctype%3D* |
Disallow | /show_bug.cgi*format%3Dmultiple* |
Allow | /describecomponents.cgi |
Allow | /describekeywords.cgi |
Disallow | /showdependency* |
Disallow | /banmyipforever.cgi |
Allow | /extensions/OpenGraph/web/ |
Allow | /sitemap/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
Other Records
Field | Value |
---|---|
sitemap | https://bugzilla.mozilla.org/sitemap/storage/v1/b/bugzilla-prod-prod-sitemap/o/sitemap_index.xml?alt=media |