bike24.com
robots.txt
Robots Exclusion Standard data for bike24.com
Resource Scan
Scan Details
| Site Domain | bike24.com |
| Base Domain | bike24.com |
| Scan Status | Ok |
| Last Scan | 2024-06-10T18:06:12+00:00 |
| Next Scan | 2024-07-10T18:06:12+00:00 |
Last Scan
| Scanned | 2024-06-10T18:06:12+00:00 |
| URL | https://bike24.com/robots.txt |
| Redirect | https://www.bike24.com/robots.txt |
| Redirect Domain | www.bike24.com |
| Redirect Base | bike24.com |
| Domain IPs | 141.101.90.96, 141.101.90.97, 141.101.90.98, 141.101.90.99, 2a06:98c1:3200::90:0, 2a06:98c1:3200::90:1, 2a06:98c1:3200::90:2, 2a06:98c1:3200::90:3 |
| Redirect IPs | 141.101.90.96, 141.101.90.97, 141.101.90.98, 141.101.90.99, 2a06:98c1:3200::90:0, 2a06:98c1:3200::90:1, 2a06:98c1:3200::90:2, 2a06:98c1:3200::90:3 |
| Response IP | 141.101.90.97 |
| Found | Yes |
| Hash | 3f9f86f7078d30593ec9b751acc274d1a4bc2285e20c8c0af27e3ccdacb285bc |
| SimHash | 300d29482dd4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax.php |
| Disallow | /api/* |
| Disallow | /cdn-cgi/* |
| Disallow | /search?* |
| Disallow | /suche?* |
| Disallow | /sale?* |
| Disallow | /search-result?* |
| Disallow | /search-result-v2?* |
| Disallow | /checkout/* |
| Disallow | /topic/* |
| Disallow | /cycling/bike/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bike24.com/sitemap_index_com.xml |