bestellen.bowlsbyhailey.nl
robots.txt
Robots Exclusion Standard data for bestellen.bowlsbyhailey.nl
Resource Scan
Scan Details
| Site Domain | bestellen.bowlsbyhailey.nl |
| Base Domain | bowlsbyhailey.nl |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-04-07T02:41:51+00:00 |
| Next Scan | 2024-07-06T02:41:51+00:00 |
Last Successful Scan
| Scanned | 2023-05-21T01:57:55+00:00 |
| URL | https://bestellen.bowlsbyhailey.nl/robots.txt |
| Domain IPs | 2600:9000:2022:0:11:e2e1:3d00:93a1, 2600:9000:2022:3000:11:e2e1:3d00:93a1, 2600:9000:2022:5c00:11:e2e1:3d00:93a1, 2600:9000:2022:6200:11:e2e1:3d00:93a1, 2600:9000:2022:aa00:11:e2e1:3d00:93a1, 2600:9000:2022:b000:11:e2e1:3d00:93a1, 2600:9000:2022:c600:11:e2e1:3d00:93a1, 2600:9000:2022:e200:11:e2e1:3d00:93a1, 54.230.112.115, 54.230.112.16, 54.230.112.2, 54.230.112.59 |
| Response IP | 54.230.112.2 |
| Found | Yes |
| Hash | f71f54d1df56188e4397b56387818618b5f9bb37c2be96a434863f6a50d0a601 |
| SimHash | 285b4086e672 |
Groups
webreaper
webcopier
offline explorer
httrack
microsoft.url.control
emailcollector
penthesilea
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /dataPrivacy |
| Disallow | /imprint |
| Disallow | /apilogindenied |
| Disallow | /autologout |
| Disallow | /commonerror |
| Disallow | /devdata |
| Disallow | /permissiondenied |
| Disallow | /nojs |
| Disallow | /newerBrowser |
| Disallow | /setIFrameSession |
| Disallow | /health |
| Disallow | /systemdata |
| Disallow | /saveCookieChoise |
| Disallow | /simulateWebsiteWithIframe |
Other Records
| Field | Value |
|---|---|
| sitemap | https://bestellen.bowlsbyhailey.nl/sitemap |