vegetables.bayer.com
robots.txt

Robots Exclusion Standard data for vegetables.bayer.com

Resource Scan

Scan Details

Site Domain vegetables.bayer.com
Base Domain bayer.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-02T01:58:41+00:00
Next Scan 2024-07-01T01:58:41+00:00

Last Successful Scan

Scanned2023-08-12T08:20:10+00:00
URL https://vegetables.bayer.com/robots.txt
Redirect https://www.vegetables.bayer.com/robots.txt
Redirect Domain www.vegetables.bayer.com
Redirect Base bayer.com
Domain IPs 99.83.202.119
Redirect IPs 96.17.96.22, 96.17.96.6
Response IP 23.33.92.158
Found Yes
Hash a3d3499e0b7566e87da332e783f1f9c4e206f15c6a58e777273fbddc79ccea22
SimHash c804d010c771

Groups

twitterbot

Rule Path
Disallow

*

Rule Path
Allow /