produceretailer.com
robots.txt

Robots Exclusion Standard data for produceretailer.com

Resource Scan

Scan Details

Site Domain produceretailer.com
Base Domain produceretailer.com
Scan Status Ok
Last Scan2024-05-29T04:27:33+00:00
Next Scan 2024-06-05T04:27:33+00:00

Last Scan

Scanned2024-05-29T04:27:33+00:00
URL https://produceretailer.com/robots.txt
Redirect https://www.producemarketguide.com:443/robots.txt
Redirect Domain www.producemarketguide.com
Redirect Base producemarketguide.com
Domain IPs 18.224.78.11, 3.129.47.41
Redirect IPs 104.26.8.21, 104.26.9.21, 172.67.72.58, 2606:4700:20::681a:815, 2606:4700:20::681a:915, 2606:4700:20::ac43:483a
Response IP 172.67.72.58
Found Yes
Hash 561c0ee35a079db03fb8af2ed27e3665244826cfb3694f20223694a9fd57613e
SimHash 4055d1114775

Groups

bingbot

Rule Path
Allow /

googlebot

Rule Path
Allow /

msnbot

Rule Path
Allow /

*

Rule Path
Disallow /