bikestall.com
robots.txt
Robots Exclusion Standard data for bikestall.com
Resource Scan
Scan Details
| Site Domain | bikestall.com |
| Base Domain | bikestall.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2026-01-16T00:13:36+00:00 |
| Next Scan | 2026-01-30T00:13:36+00:00 |
Last Successful Scan
| Scanned | 2026-01-01T00:09:56+00:00 |
| URL | https://bikestall.com/robots.txt |
| Redirect | https://www.bikestall.com/robots.txt |
| Redirect Domain | www.bikestall.com |
| Redirect Base | bikestall.com |
| Domain IPs | 2a02:4780:84:1c0e:bd25:fce1:cc9b:5f60, 2a02:4780:84:4c18:b28f:d79:cb5:9163, 84.32.84.156, 84.32.84.98 |
| Redirect IPs | 2a02:4780:15:26a5:91e4:5714:c586:a9e6, 2a02:4780:39:a2b:9638:fc57:5cb3:d47d, 84.32.84.219, 84.32.84.91 |
| Response IP | 91.108.100.131 |
| Found | Yes |
| Hash | e73816c2ddd22ee1ca4900e00ddb9bb6ef2f50c633afbafe240b9d25c9ce4271 |
| SimHash | 7d245a54d492 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /configs/ |
| Disallow | /cp/ |
| Disallow | /go.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bikestall.com/sitemap.xml |