go.cd
robots.txt
Robots Exclusion Standard data for go.cd
Resource Scan
Scan Details
| Site Domain | go.cd |
| Base Domain | go.cd |
| Scan Status | Ok |
| Last Scan | 2024-05-18T08:58:41+00:00 |
| Next Scan | 2024-06-17T08:58:41+00:00 |
Last Scan
| Scanned | 2024-05-18T08:58:41+00:00 |
| URL | https://go.cd/robots.txt |
| Redirect | https://www.gocd.org/robots.txt |
| Redirect Domain | www.gocd.org |
| Redirect Base | gocd.org |
| Domain IPs | 13.33.88.12, 13.33.88.27, 13.33.88.45, 13.33.88.80, 2600:9000:223b:0:9:2ce:ee40:93a1, 2600:9000:223b:1000:9:2ce:ee40:93a1, 2600:9000:223b:3c00:9:2ce:ee40:93a1, 2600:9000:223b:5a00:9:2ce:ee40:93a1, 2600:9000:223b:7000:9:2ce:ee40:93a1, 2600:9000:223b:8a00:9:2ce:ee40:93a1, 2600:9000:223b:ba00:9:2ce:ee40:93a1, 2600:9000:223b:f400:9:2ce:ee40:93a1 |
| Redirect IPs | 13.33.30.111, 13.33.30.68, 13.33.30.89, 13.33.30.9, 2600:9000:229f:1e00:9:7645:dc80:93a1, 2600:9000:229f:2200:9:7645:dc80:93a1, 2600:9000:229f:400:9:7645:dc80:93a1, 2600:9000:229f:600:9:7645:dc80:93a1, 2600:9000:229f:6200:9:7645:dc80:93a1, 2600:9000:229f:e200:9:7645:dc80:93a1, 2600:9000:229f:ec00:9:7645:dc80:93a1, 2600:9000:229f:fe00:9:7645:dc80:93a1 |
| Response IP | 13.33.30.68 |
| Found | Yes |
| Hash | 9ee2dfec46ac8d53e75c229ef40adce432e38bd1e9a1195a532fc7b1b2c8c75b |
| SimHash | 480c8872c3b1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /next-release |
| Disallow | /next-release/index.html |
| Disallow | /next-release.html |
| Disallow | /continuous-delivery |
| Disallow | /continuous-delivery/index.html |
| Disallow | /continuous-delivery.html |
| Disallow | /sales-sign-up |
| Disallow | /sales-sign-up/index.html |
| Disallow | /sales-sign-up.html |
| Disallow | /glossary |
| Disallow | /glossary/index.html |
| Disallow | /glossary.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.gocd.org/sitemap.xml |