rac1.cat
robots.txt
Robots Exclusion Standard data for rac1.cat
Resource Scan
Scan Details
Site Domain | rac1.cat |
Base Domain | rac1.cat |
Scan Status | Ok |
Last Scan | 2024-05-16T19:14:13+00:00 |
Next Scan | 2024-05-23T19:14:13+00:00 |
Last Scan
Scanned | 2024-05-16T19:14:13+00:00 |
URL | https://rac1.cat/robots.txt |
Redirect | https://www.rac1.cat/robots.txt |
Redirect Domain | www.rac1.cat |
Redirect Base | rac1.cat |
Domain IPs | 213.4.81.197, 88.87.219.197 |
Redirect IPs | 104.103.151.13 |
Response IP | 23.39.14.231 |
Found | Yes |
Hash | 519f44a58bb43ebc787dc24d15ecdb5f0bf9d33611fd23c4437be2866a7c4bbf |
SimHash | a0d279c6cef3 |
Groups
*
Rule | Path |
---|---|
Allow | /ads.txt |
Disallow | /.swf$ |
Disallow | /.tif$ |
Disallow | /.mp3$ |
Disallow | /.flv$ |
Disallow | /.mp4$ |
Disallow | /.avi$ |
Disallow | /.txt$ |
Disallow | /.ics$ |
Comments