consum.gencat.cat
robots.txt
Robots Exclusion Standard data for consum.gencat.cat
Resource Scan
Scan Details
Site Domain | consum.gencat.cat |
Base Domain | gencat.cat |
Scan Status | Ok |
Last Scan | 2024-11-16T13:19:08+00:00 |
Next Scan | 2024-12-16T13:19:08+00:00 |
Last Scan
Scanned | 2024-11-16T13:19:08+00:00 |
URL | https://consum.gencat.cat/robots.txt |
Redirect | https://consum.gencat.cat/web/robots.txt |
Domain IPs | 2600:1413:b000:6::17d5:2bc4, 2600:1413:b000:6::17d5:2bd7, 96.17.96.29, 96.17.96.30 |
Response IP | 104.81.138.11 |
Found | Yes |
Hash | e5d2217f9853879807b50d3eabc6b614620f2f1d68f6d72a2d02f9a2fa17084c |
SimHash | 0d7dfa124547 |
Groups
*
Rule | Path |
---|---|
Disallow | / |
Comments