foodlavie.com
robots.txt

Robots Exclusion Standard data for foodlavie.com

Resource Scan

Scan Details

Site Domain foodlavie.com
Base Domain foodlavie.com
Scan Status Ok
Last Scan2024-06-29T17:54:17+00:00
Next Scan 2024-07-06T17:54:17+00:00

Last Scan

Scanned2024-06-29T17:54:17+00:00
URL https://foodlavie.com/robots.txt
Redirect https://www.zeste.ca/robots.txt
Redirect Domain www.zeste.ca
Redirect Base zeste.ca
Domain IPs 54.192.18.106, 54.192.18.120, 54.192.18.52, 54.192.18.87
Redirect IPs 23.52.40.64, 23.52.40.74, 2600:1413:a000::172c:420, 2600:1413:a000::172c:448
Response IP 23.59.168.185
Found Yes
Hash 5532a2ec238a9cf0e21a62ecdb442fcf22bff4aa490c792880f0f406752b17ef
SimHash c804c3f3c763

Groups

*

Rule Path
Allow /
Disallow /brouillons

Comments

  • Basic Crawler setup. We allow for everything