grandandtoy.com
robots.txt
Robots Exclusion Standard data for grandandtoy.com
Resource Scan
Scan Details
| Site Domain | grandandtoy.com |
| Base Domain | grandandtoy.com |
| Scan Status | Ok |
| Last Scan | 2024-09-17T20:48:23+00:00 |
| Next Scan | 2024-10-17T20:48:23+00:00 |
Last Scan
| Scanned | 2024-09-17T20:48:23+00:00 |
| URL | https://grandandtoy.com/robots.txt |
| Domain IPs | 8.42.203.11 |
| Response IP | 8.42.203.11 |
| Found | Yes |
| Hash | 16f0e91928e80eb918004bd13aadc9bf1078087bb65c1eecf22f4db8df6b4ad7 |
| SimHash | c7409053d760 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /education/ |
| Disallow | /kiosk/ |
| Disallow | /CorporatePages/ |
| Disallow | /Popup/ |
| Disallow | /Checkout/ |
| Disallow | /*SignIn.aspx |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.grandandtoy.com/sitemap.xml |
Warnings
- `host` is not a known field.
Comments