buildkite.com
robots.txt
Robots Exclusion Standard data for buildkite.com
Resource Scan
Scan Details
Site Domain | buildkite.com |
Base Domain | buildkite.com |
Scan Status | Ok |
Last Scan | 2024-05-17T18:05:28+00:00 |
Next Scan | 2024-06-16T18:05:28+00:00 |
Last Scan
Scanned | 2024-05-17T18:05:28+00:00 |
URL | https://buildkite.com/robots.txt |
Domain IPs | 18.155.68.128, 18.155.68.33, 18.155.68.52, 18.155.68.96, 2600:9000:23d2:1400:4:17ba:a80:93a1, 2600:9000:23d2:4000:4:17ba:a80:93a1, 2600:9000:23d2:4200:4:17ba:a80:93a1, 2600:9000:23d2:4600:4:17ba:a80:93a1, 2600:9000:23d2:9a00:4:17ba:a80:93a1, 2600:9000:23d2:b000:4:17ba:a80:93a1, 2600:9000:23d2:c000:4:17ba:a80:93a1, 2600:9000:23d2:ea00:4:17ba:a80:93a1 |
Response IP | 18.155.68.33 |
Found | Yes |
Hash | dad51eaae6f0978d143ae301c9d0546ae76f6b7a75a1c0839ed2f9405d9c0120 |
SimHash | cc0041590db6 |
Groups
*
Rule | Path |
---|---|
Disallow | /*?*page= |
Disallow | /*/*/builds/ |
Disallow | /*/*/builds? |
Disallow | /pipelines/templates*?* |
Other Records
Field | Value |
---|---|
sitemap | https://buildkite.com/sitemap_index.xml |
Warnings
- `host` is not a known field.
Comments