getbedscrunchie.io
robots.txt
Robots Exclusion Standard data for getbedscrunchie.io
Resource Scan
Scan Details
| Site Domain | getbedscrunchie.io |
| Base Domain | getbedscrunchie.io |
| Scan Status | Ok |
| Last Scan | 2025-12-01T20:12:46+00:00 |
| Next Scan | 2025-12-31T20:12:46+00:00 |
Last Scan
| Scanned | 2025-12-01T20:12:46+00:00 |
| URL | https://getbedscrunchie.io/robots.txt |
| Domain IPs | 151.101.131.220, 151.101.195.220, 151.101.3.220, 151.101.67.220, 2a04:4e42:200::988, 2a04:4e42:400::988, 2a04:4e42:600::988, 2a04:4e42::988 |
| Response IP | 151.101.131.220 |
| Found | Yes |
| Hash | c7f112f6d95711d256bc1487960920a241758e8ac5c8a60524f1cbc975d228f2 |
| SimHash | 6940d8f2cab1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /checkout |
| Disallow | /thank-you |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |