grogtag.com
robots.txt
Robots Exclusion Standard data for grogtag.com
Resource Scan
Scan Details
| Site Domain | grogtag.com |
| Base Domain | grogtag.com |
| Scan Status | Ok |
| Last Scan | 2025-07-21T06:08:38+00:00 |
| Next Scan | 2025-08-20T06:08:38+00:00 |
Last Scan
| Scanned | 2025-07-21T06:08:38+00:00 |
| URL | https://grogtag.com/robots.txt |
| Redirect | https://www.grogtag.com/robots.txt |
| Redirect Domain | www.grogtag.com |
| Redirect Base | grogtag.com |
| Domain IPs | 104.21.1.231, 172.67.152.143, 2606:4700:3032::ac43:988f, 2606:4700:3036::6815:1e7 |
| Redirect IPs | 104.21.1.231, 172.67.152.143, 2606:4700:3032::ac43:988f, 2606:4700:3036::6815:1e7 |
| Response IP | 172.67.152.143 |
| Found | Yes |
| Hash | 8e18df3e7951333cdd704f3994feb5f0bf7ed30f7170f3a766202c4591fb1c95 |
| SimHash | 39004af06a0f |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /content/files/ |
| Disallow | /compareproducts |
| Disallow | /clearcomparelist |
| Disallow | /logout |
| Disallow | /orderdetails |
| Disallow | /returnrequest |
| Disallow | /passwordrecovery/confirm |
| Disallow | /newsletter/subscriptionactivation |
| Disallow | /boards/postedit |
| Disallow | /boards/postdelete |
| Disallow | /boards/postcreate |
| Disallow | /boards/topicedit |
| Disallow | /boards/topicdelete |
| Disallow | /boards/topiccreate |
| Disallow | /boards/topicmove |
| Disallow | /boards/topicwatch |
| Disallow | /boards/forumwatch |
| Disallow | /privatemessages |
| Disallow | /inboxupdate |
| Disallow | /sentupdate |
| Disallow | /sendpm |
| Disallow | /viewpm |
| Disallow | /deletepm |
| Disallow | /productreviews/* |
| Disallow | /CF/* |
| Allow | /CF/Theme/* |
| Allow | /CF/Scales/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.grogtag.com/sitemapseo |