terrassa.cat
robots.txt
Robots Exclusion Standard data for terrassa.cat
Resource Scan
Scan Details
Site Domain | terrassa.cat |
Base Domain | terrassa.cat |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2/16/2025, 5:51:00 PM |
Next Scan | 5/17/2025, 5:51:00 PM |
Last Successful Scan
Scanned | 1/2/2023, 12:12:03 AM |
URL | https://www.terrassa.cat/robots.txt |
Domain IPs | 104.26.8.183, 104.26.9.183, 172.67.72.223, 2606:4700:20::681a:8b7, 2606:4700:20::681a:9b7, 2606:4700:20::ac43:48df |
Response IP | 104.26.8.183 |
Found | Yes |
Hash | e8302c5917893624eb3431096ff192ef2a38c7da82544149bca97cd171a0668f |
SimHash | 85095c348fd1 |
Groups
*
Rule | Path |
---|---|
Disallow | /Front/ |
Disallow | /es/web/ajuntament-de-terrassa/agenda-de-premsa |
Disallow | /web/ajuntament-de-terrassa/agenda-de-premsa |
Disallow | /agenda-de-premsa |
Disallow | /es/agenda-de-premsa |
Other Records
Field | Value |
---|---|
sitemap | http://www.terrassa.cat/sitemap.xml |