cavwine.com
robots.txt

Robots Exclusion Standard data for cavwine.com

Resource Scan

Scan Details

Site Domain cavwine.com
Base Domain cavwine.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2024-08-12T14:45:23+00:00
Next Scan 2024-10-11T14:45:23+00:00

Last Successful Scan

Scanned2024-06-14T14:44:17+00:00
URL https://cavwine.com/robots.txt
Redirect https://www.cavwine.com/robots.txt
Redirect Domain www.cavwine.com
Redirect Base cavwine.com
Domain IPs 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Redirect IPs 2404:6800:4003:c00::79, 74.125.200.121
Response IP 142.251.175.121
Found Yes
Hash 7b565789b37943ad1d5fed467f7818f22466eb5293a28aa50bdea8466d4ff420
SimHash 4b049660c792

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Allow /

Other Records

Field Value
sitemap https://www.cavwine.com/sitemap.xml