datos.cali.gov.co
robots.txt
Robots Exclusion Standard data for datos.cali.gov.co
Resource Scan
Scan Details
Site Domain | datos.cali.gov.co |
Base Domain | cali.gov.co |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 3/15/2025, 4:13:48 PM |
Next Scan | 6/13/2025, 4:13:48 PM |
Last Successful Scan
Scanned | 5/26/2024, 4:11:14 PM |
URL | https://datos.cali.gov.co/robots.txt |
Domain IPs | 18.206.7.125, 3.208.69.163 |
Response IP | 3.208.69.163 |
Found | Yes |
Hash | 064150d0466e18193f572f16ffe8573cf2dc7ff94ed06bbb9ff7f23019360dca |
SimHash | 4d30cc20a202 |
Groups
*
Rule | Path |
---|---|
Disallow | /dataset/rate/ |
Disallow | /revision/ |
Disallow | /dataset/*/history |
Disallow | /api/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |