kleinecampingplaetze.de
robots.txt
Robots Exclusion Standard data for kleinecampingplaetze.de
Resource Scan
Scan Details
| Site Domain | kleinecampingplaetze.de |
| Base Domain | kleinecampingplaetze.de |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-26T17:16:16+00:00 |
| Next Scan | 2024-08-24T17:16:16+00:00 |
Last Successful Scan
| Scanned | 2023-01-09T13:31:58+00:00 |
| URL | https://kleinecampingplaetze.de/robots.txt |
| Redirect | https://www.kleinecampingplaetze.de/robots.txt |
| Redirect Domain | www.kleinecampingplaetze.de |
| Redirect Base | kleinecampingplaetze.de |
| Domain IPs | 80.95.166.55 |
| Redirect IPs | 2600:1413:b000:6::17d5:2bd4, 2600:1413:b000:6::17d5:2bd9, 96.17.96.12, 96.17.96.17 |
| Response IP | 104.81.138.73 |
| Found | Yes |
| Hash | 8e70d96360f940759f11a890930d49c76c252f5e67c3d55e29c92fe0a533952b |
| SimHash | 6f4dd820d511 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /maintenance.html |
| Disallow | /cpc/out/ |
| Disallow | /campsite/search/ |
| Disallow | /campsite/review/ |
| Disallow | /dfp/ |
| Disallow | /campsite/download-pdf/ |
msnbot
| Rule | Path |
|---|---|
| Disallow | /maintenance.html |
| Disallow | /cpc/out/ |
| Disallow | /campsite/search/ |
| Disallow | /campsite/review/ |
| Disallow | /dfp/ |
| Disallow | /campsite/download-pdf/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
bingbot
| Rule | Path |
|---|---|
| Disallow | /maintenance.html |
| Disallow | /cpc/out/ |
| Disallow | /campsite/search/ |
| Disallow | /campsite/review/ |
| Disallow | /dfp/ |
| Disallow | /campsite/download-pdf/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
slurp
| Rule | Path |
|---|---|
| Disallow | /maintenance.html |
| Disallow | /cpc/out/ |
| Disallow | /campsite/search/ |
| Disallow | /campsite/review/ |
| Disallow | /dfp/ |
| Disallow | /campsite/download-pdf/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
yandex
| Rule | Path |
|---|---|
| Disallow | /maintenance.html |
| Disallow | /cpc/out/ |
| Disallow | /campsite/search/ |
| Disallow | /campsite/review/ |
| Disallow | /dfp/ |
| Disallow | /campsite/download-pdf/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
duckduckbot
| Rule | Path |
|---|---|
| Disallow | /maintenance.html |
| Disallow | /cpc/out/ |
| Disallow | /campsite/search/ |
| Disallow | /campsite/review/ |
| Disallow | /dfp/ |
| Disallow | /campsite/download-pdf/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
mj12bot
| Rule | Path |
|---|---|
| Disallow | /maintenance.html |
| Disallow | /cpc/out/ |
| Disallow | /campsite/search/ |
| Disallow | /campsite/review/ |
| Disallow | /dfp/ |
| Disallow | /campsite/download-pdf/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.kleinecampingplaetze.de/sitemap/sitemap.de.xml |
Comments