voila.com
robots.txt

Robots Exclusion Standard data for voila.com

Resource Scan

Scan Details

Site Domain voila.com
Base Domain voila.com
Scan Status Ok
Last Scan2024-11-15T09:12:40+00:00
Next Scan 2024-12-15T09:12:40+00:00

Last Scan

Scanned2024-11-15T09:12:40+00:00
URL http://voila.com/robots.txt
Redirect https://voila.ca/robots.txt
Redirect Domain voila.ca
Redirect Base voila.ca
Domain IPs 69.49.101.52
Redirect IPs 13.226.2.126, 13.226.2.71, 13.226.2.75, 13.226.2.78
Response IP 3.164.206.38
Found Yes
Hash 708441629853a891503ea10a3de2c0e05f7d83ba9bb85d25fb816ce24fbc7447
SimHash ca05d5026f22

Groups

*

Rule Path
Disallow /sso-login
Disallow /content/dp
Disallow /content/dp/

pinterestbot

Rule Path
Disallow /api/v5/products/search
Disallow /api/v4/products/search
Disallow /products/search

Other Records

Field Value
crawl-delay 10

Comments

  • http://www.pinterest.com/bot.html