bikester.pl
robots.txt
Robots Exclusion Standard data for bikester.pl
Resource Scan
Scan Details
| Site Domain | bikester.pl |
| Base Domain | bikester.pl |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-10-30T23:52:29+00:00 |
| Next Scan | 2025-01-28T23:52:29+00:00 |
Last Successful Scan
| Scanned | 2024-06-10T23:25:57+00:00 |
| URL | https://bikester.pl/robots.txt |
| Redirect | https://www.bikester.pl/robots.txt |
| Redirect Domain | www.bikester.pl |
| Redirect Base | bikester.pl |
| Domain IPs | 108.157.254.15, 108.157.254.24, 108.157.254.61, 108.157.254.89, 2600:9000:2753:4a00:12:e05c:4480:93a1, 2600:9000:2753:4c00:12:e05c:4480:93a1, 2600:9000:2753:7400:12:e05c:4480:93a1, 2600:9000:2753:8600:12:e05c:4480:93a1, 2600:9000:2753:a400:12:e05c:4480:93a1, 2600:9000:2753:ae00:12:e05c:4480:93a1, 2600:9000:2753:d000:12:e05c:4480:93a1, 2600:9000:2753:f000:12:e05c:4480:93a1 |
| Redirect IPs | 104.17.88.89, 104.17.89.89 |
| Response IP | 104.17.88.89 |
| Found | Yes |
| Hash | def4f6748fdbc818ea0461887993a568969985edf8b05aa8996e33d08d5e58c1 |
| SimHash | 732c1d4a8c90 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *?*pmax=* |
| Disallow | *?*pmin=* |
| Disallow | *?*pmid=* |
| Disallow | *?*original=* |
| Disallow | /search/ |
| Disallow | *?*q=* |
| Disallow | /on/demandware.store/Sites-bikester-pl-Site/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bikester.pl/sitemap_index.xml |