the-grove.com
robots.txt

Robots Exclusion Standard data for the-grove.com

Resource Scan

Scan Details

Site Domain the-grove.com
Base Domain the-grove.com
Scan Status Ok
Last Scan2025-12-01T15:50:58+00:00
Next Scan 2025-12-31T15:50:58+00:00

Last Scan

Scanned2025-12-01T15:50:58+00:00
URL https://the-grove.com/robots.txt
Redirect https://www.the-grove.com/robots.txt
Redirect Domain www.the-grove.com
Redirect Base the-grove.com
Domain IPs 199.34.228.48
Redirect IPs 199.34.228.48
Response IP 199.34.228.48
Found Yes
Hash 315de476c13432158e5813104b06b322531f0b8bd0a86bf6464d4b1a630d6309
SimHash c0145856a2b3

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /http%3A//www.theknot.com/wedding-songs
Disallow /https%3A//www.mplaceproductions.com/the-grove/
Disallow /http%3A//vegaslightsphotography.com
Disallow /https%3A//www.theknot.com/marketplace/the-grove-las-vegas-weddings-at-the-grove-las-vegas-nv-251174

Other Records

Field Value
sitemap https://www.the-grove.com/sitemap.xml