mediterranean-stay.com
robots.txt
Robots Exclusion Standard data for mediterranean-stay.com
Resource Scan
Scan Details
Site Domain | mediterranean-stay.com |
Base Domain | mediterranean-stay.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2/15/2025, 9:42:54 AM |
Next Scan | 5/16/2025, 9:42:54 AM |
Last Successful Scan
Scanned | 10/2/2023, 7:39:24 AM |
URL | https://mediterranean-stay.com/robots.txt |
Domain IPs | 104.21.21.167, 172.67.199.161, 2606:4700:3032::ac43:c7a1, 2606:4700:3033::6815:15a7 |
Response IP | 104.21.21.167 |
Found | Yes |
Hash | 3e6fe83366ea5ac4ef0cd964a3c0ece9b8b0aca1534d65cb215945894b61c9a5 |
SimHash | 821fc5f2ecba |
Groups
*
Rule | Path |
---|---|
Disallow | /*/ghw.html |
Disallow | /*/gtb.html |
Disallow | /dist/images/c/f.php |
Disallow | /cp/* |
Disallow | /cp/about.html |
Disallow | /cp/cookie-policy.html |
Disallow | /cp/terms-of-service.html |