delivery.gobysteffenhenssler.com
robots.txt
Robots Exclusion Standard data for delivery.gobysteffenhenssler.com
Resource Scan
Scan Details
| Site Domain | delivery.gobysteffenhenssler.com |
| Base Domain | gobysteffenhenssler.com |
| Scan Status | Ok |
| Last Scan | 2024-06-18T05:18:46+00:00 |
| Next Scan | 2024-07-18T05:18:46+00:00 |
Last Scan
| Scanned | 2024-06-18T05:18:46+00:00 |
| URL | https://delivery.gobysteffenhenssler.com/robots.txt |
| Domain IPs | 2600:9000:2024:1600:6:26ba:2a00:93a1, 2600:9000:2024:3000:6:26ba:2a00:93a1, 2600:9000:2024:4400:6:26ba:2a00:93a1, 2600:9000:2024:7c00:6:26ba:2a00:93a1, 2600:9000:2024:9600:6:26ba:2a00:93a1, 2600:9000:2024:aa00:6:26ba:2a00:93a1, 2600:9000:2024:b800:6:26ba:2a00:93a1, 2600:9000:2024:fa00:6:26ba:2a00:93a1, 99.84.203.125, 99.84.203.46, 99.84.203.65, 99.84.203.8 |
| Response IP | 3.160.246.116 |
| Found | Yes |
| Hash | 12118d40f1c2aa55357613b4fb0f5ded95c62139f34142f8dbb28539c804d60a |
| SimHash | 28594086e672 |
Groups
webreaper
webcopier
offline explorer
httrack
microsoft.url.control
emailcollector
penthesilea
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /dataPrivacy |
| Disallow | /imprint |
| Disallow | /apilogindenied |
| Disallow | /autologout |
| Disallow | /commonerror |
| Disallow | /devdata |
| Disallow | /permissiondenied |
| Disallow | /nojs |
| Disallow | /newerBrowser |
| Disallow | /setIFrameSession |
| Disallow | /health |
| Disallow | /systemdata |
| Disallow | /saveCookieChoise |
| Disallow | /simulateWebsiteWithIframe |
Other Records
| Field | Value |
|---|---|
| sitemap | https://delivery.gobysteffenhenssler.com/sitemap |