grove.co
robots.txt

Robots Exclusion Standard data for grove.co

Resource Scan

Scan Details

Site Domain grove.co
Base Domain grove.co
Scan Status Ok
Last Scan2024-10-11T06:59:13+00:00
Next Scan 2024-10-18T06:59:13+00:00

Last Scan

Scanned2024-10-11T06:59:13+00:00
URL https://grove.co/robots.txt
Redirect https://www.grove.co/robots.txt
Redirect Domain www.grove.co
Redirect Base grove.co
Domain IPs 172.66.40.104, 172.66.43.152, 2606:4700:3108::ac42:2868, 2606:4700:3108::ac42:2b98
Redirect IPs 172.66.40.104, 172.66.43.152, 2606:4700:3108::ac42:2868, 2606:4700:3108::ac42:2b98
Response IP 172.66.40.104
Found Yes
Hash 67889919f4a81ce1c5e374b554f334050dc80cfa8cf8eb25757d2eeb38607200
SimHash 480b4434eab7

Groups

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

*

Rule Path
Disallow /swatch
Disallow /api/*
Disallow /referrer/
Disallow /api/
Disallow /order-review*
Disallow /pantry*
Disallow /catalog/?q*
Disallow /login*
Disallow /payment*
Disallow /referral/
Disallow /ship-now/
Disallow /review*
Disallow /accounts/*
Disallow /null
Disallow /how-it-works/*
Disallow /refcen*
Disallow /undefined
Disallow /?clickid=*
Disallow /rid%3D*
Disallow /%26v%3D*
Disallow /guide/

pinterestbot

Rule Path
Disallow /
Disallow /*
Disallow /catalog/product*
Disallow /welcome/*

pinterest

Rule Path
Disallow /
Disallow /*
Disallow /catalog/product*
Disallow /welcome/*

mozilla/5.0 (compatible; pinterestbot/1.0; +http://www.pinterest.com/bot.html)

Rule Path
Disallow /
Disallow /*
Disallow /catalog/product*
Disallow /welcome/*

Other Records

Field Value
sitemap https://www.grove.co/sitemap.xml