go.cd
robots.txt
Robots Exclusion Standard data for go.cd
Resource Scan
Scan Details
| Site Domain | go.cd |
| Base Domain | go.cd |
| Scan Status | Ok |
| Last Scan | 2024-11-14T09:00:09+00:00 |
| Next Scan | 2024-12-14T09:00:09+00:00 |
Last Scan
| Scanned | 2024-11-14T09:00:09+00:00 |
| URL | https://go.cd/robots.txt |
| Redirect | https://www.gocd.org/robots.txt |
| Redirect Domain | www.gocd.org |
| Redirect Base | gocd.org |
| Domain IPs | 13.33.88.12, 13.33.88.27, 13.33.88.45, 13.33.88.80, 2600:9000:223b:0:9:2ce:ee40:93a1, 2600:9000:223b:1000:9:2ce:ee40:93a1, 2600:9000:223b:3200:9:2ce:ee40:93a1, 2600:9000:223b:5600:9:2ce:ee40:93a1, 2600:9000:223b:6c00:9:2ce:ee40:93a1, 2600:9000:223b:8c00:9:2ce:ee40:93a1, 2600:9000:223b:ec00:9:2ce:ee40:93a1, 2600:9000:223b:f000:9:2ce:ee40:93a1 |
| Redirect IPs | 13.33.28.125, 13.33.28.36, 13.33.28.79, 13.33.28.98, 2600:9000:229f:1400:9:7645:dc80:93a1, 2600:9000:229f:1800:9:7645:dc80:93a1, 2600:9000:229f:2a00:9:7645:dc80:93a1, 2600:9000:229f:6000:9:7645:dc80:93a1, 2600:9000:229f:8200:9:7645:dc80:93a1, 2600:9000:229f:8400:9:7645:dc80:93a1, 2600:9000:229f:c600:9:7645:dc80:93a1, 2600:9000:229f:ec00:9:7645:dc80:93a1 |
| Response IP | 13.33.28.79 |
| Found | Yes |
| Hash | 9ee2dfec46ac8d53e75c229ef40adce432e38bd1e9a1195a532fc7b1b2c8c75b |
| SimHash | 480c8872c3b1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /next-release |
| Disallow | /next-release/index.html |
| Disallow | /next-release.html |
| Disallow | /continuous-delivery |
| Disallow | /continuous-delivery/index.html |
| Disallow | /continuous-delivery.html |
| Disallow | /sales-sign-up |
| Disallow | /sales-sign-up/index.html |
| Disallow | /sales-sign-up.html |
| Disallow | /glossary |
| Disallow | /glossary/index.html |
| Disallow | /glossary.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.gocd.org/sitemap.xml |