gavros.gr
robots.txt
Robots Exclusion Standard data for gavros.gr
Resource Scan
Scan Details
Site Domain | gavros.gr |
Base Domain | gavros.gr |
Scan Status | Ok |
Last Scan | 2024-09-15T12:37:53+00:00 |
Next Scan | 2024-09-22T12:37:53+00:00 |
Last Scan
Scanned | 2024-09-15T12:37:53+00:00 |
URL | https://gavros.gr/robots.txt |
Redirect | https://www.gavros.gr/robots.txt |
Redirect Domain | www.gavros.gr |
Redirect Base | gavros.gr |
Domain IPs | 88.198.92.230 |
Redirect IPs | 104.21.75.228, 172.67.182.230, 2606:4700:3030::ac43:b6e6, 2606:4700:3033::6815:4be4 |
Response IP | 172.67.182.230 |
Found | Yes |
Hash | 3c4f382b725644b2980dfc1725dba557195a6e4ad46cd7cf0ad6380dd51bc193 |
SimHash | ec00dc04cb51 |
Groups
*
Rule | Path |
---|---|
Disallow | /ajax |
Disallow | /admin |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |