opendata.terrassa.cat
robots.txt
Robots Exclusion Standard data for opendata.terrassa.cat
Resource Scan
Scan Details
| Site Domain | opendata.terrassa.cat |
| Base Domain | terrassa.cat |
| Scan Status | Ok |
| Last Scan | 2025-03-21T05:17:26+00:00 |
| Next Scan | 2025-04-20T05:17:26+00:00 |
Last Scan
| Scanned | 2025-03-21T05:17:26+00:00 |
| URL | https://opendata.terrassa.cat/robots.txt |
| Domain IPs | 104.26.8.183, 104.26.9.183, 172.67.72.223, 2606:4700:20::681a:8b7, 2606:4700:20::681a:9b7, 2606:4700:20::ac43:48df |
| Response IP | 104.26.9.183 |
| Found | Yes |
| Hash | 064150d0466e18193f572f16ffe8573cf2dc7ff94ed06bbb9ff7f23019360dca |
| SimHash | 4d30cc20a202 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /dataset/rate/ |
| Disallow | /revision/ |
| Disallow | /dataset/*/history |
| Disallow | /api/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |