redlinestands.com
robots.txt
Robots Exclusion Standard data for redlinestands.com
Resource Scan
Scan Details
| Site Domain | redlinestands.com |
| Base Domain | redlinestands.com |
| Scan Status | Ok |
| Last Scan | 2024-05-10T15:21:16+00:00 |
| Next Scan | 2024-06-09T15:21:16+00:00 |
Last Scan
| Scanned | 2024-05-10T15:21:16+00:00 |
| URL | https://redlinestands.com/robots.txt |
| Redirect | https://www.redlinestands.com/catalog/robots.txt |
| Redirect Domain | www.redlinestands.com |
| Redirect Base | redlinestands.com |
| Domain IPs | 104.26.4.179, 104.26.5.179, 172.67.71.47, 2606:4700:20::681a:4b3, 2606:4700:20::681a:5b3, 2606:4700:20::ac43:472f |
| Redirect IPs | 104.26.4.179, 104.26.5.179, 172.67.71.47, 2606:4700:20::681a:4b3, 2606:4700:20::681a:5b3, 2606:4700:20::ac43:472f |
| Response IP | 104.26.4.179 |
| Found | Yes |
| Hash | e297a611fb900597d5f0f7e34763f53477d22f89d6d149ff54d66585f46b5b90 |
| SimHash | 6104ddd57614 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /catalog/ |
| Disallow | /dev/ |
| Disallow | /staging/ |
| Disallow | /test6y7/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.redlinestands.com/catalog/sitemap.xml |