r1s-test.com
robots.txt
Robots Exclusion Standard data for r1s-test.com
Resource Scan
Scan Details
| Site Domain | r1s-test.com |
| Base Domain | r1s-test.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-04-22T01:51:07+00:00 |
| Next Scan | 2025-05-06T01:51:07+00:00 |
Last Successful Scan
| Scanned | 2025-03-14T23:46:25+00:00 |
| URL | https://r1s-test.com/robots.txt |
| Domain IPs | 52.84.45.12, 52.84.45.40, 52.84.45.89, 52.84.45.91 |
| Response IP | 108.156.22.50 |
| Found | Yes |
| Hash | 6485368aa78cc355a4d2416558da97fd2d75232dfa0351c1bfaba9a0473d0969 |
| SimHash | 6308dc440e52 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /account/* |
| Disallow | /cart |
| Disallow | /cart/* |
| Disallow | /api |
| Disallow | /api/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.recreation.gov/sitemap.xml.gz |