bikester.dk
robots.txt
Robots Exclusion Standard data for bikester.dk
Resource Scan
Scan Details
| Site Domain | bikester.dk |
| Base Domain | bikester.dk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-06-07T03:47:46+00:00 |
| Next Scan | 2024-08-06T03:47:46+00:00 |
Last Successful Scan
| Scanned | 2024-03-17T03:46:27+00:00 |
| URL | https://bikester.dk/robots.txt |
| Redirect | https://www.bikester.dk/robots.txt |
| Redirect Domain | www.bikester.dk |
| Redirect Base | bikester.dk |
| Domain IPs | 2600:9000:2022:7400:11:465d:7a80:93a1, 2600:9000:2022:9a00:11:465d:7a80:93a1, 2600:9000:2022:9e00:11:465d:7a80:93a1, 2600:9000:2022:a200:11:465d:7a80:93a1, 2600:9000:2022:c000:11:465d:7a80:93a1, 2600:9000:2022:e400:11:465d:7a80:93a1, 2600:9000:2022:f600:11:465d:7a80:93a1, 2600:9000:2022:f800:11:465d:7a80:93a1, 54.230.112.102, 54.230.112.109, 54.230.112.46, 54.230.112.70 |
| Redirect IPs | 104.16.63.42, 104.16.64.42 |
| Response IP | 104.16.63.42 |
| Found | Yes |
| Hash | 048bf9c6011230d54183eec29305fdff3aa123c8b6980857f1adc11bbb076a3e |
| SimHash | 713ccd028c80 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *?*pmax=* |
| Disallow | *?*pmin=* |
| Disallow | *?*pmid=* |
| Disallow | *?*original=* |
| Disallow | /search/ |
| Disallow | *?*q=* |
| Disallow | /on/demandware.store/Sites-bikester-dk-Site/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bikester.dk/sitemap_index.xml |