weg.de
robots.txt
Robots Exclusion Standard data for weg.de
Resource Scan
Scan Details
| Site Domain | weg.de |
| Base Domain | weg.de |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-04-02T11:14:40+00:00 |
| Next Scan | 2024-07-01T11:14:40+00:00 |
Last Successful Scan
| Scanned | 2023-09-03T03:31:34+00:00 |
| URL | https://weg.de/robots.txt |
| Redirect | https://www.weg.de/robots.txt |
| Redirect Domain | www.weg.de |
| Redirect Base | weg.de |
| Domain IPs | 18.184.45.188, 18.196.10.46, 35.157.232.155 |
| Redirect IPs | 18.184.45.188, 18.196.10.46, 35.157.232.155 |
| Response IP | 35.157.232.155 |
| Found | Yes |
| Hash | f707061dd86a58386ab056800aaef87aebca7900c2d2be08780cd661405ae08a |
| SimHash | eb1ff9644f73 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /urlaub/liste |
| Disallow | /hotels/liste |
| Disallow | /urlaub/reisziele/ |
| Disallow | /hotels/reiseziele |
| Disallow | /session |
| Disallow | /view/services/ |
| Disallow | /view/banner/ |
| Disallow | /widgetsrc/ |
| Disallow | /res/oneslider/ |
| Disallow | /newsletter-abbestellen |
| Disallow | /newsletter-abmelden |
| Disallow | /service/track/v1/events |
| Disallow | /reisemagazin |
| Disallow | /system/ |
| Disallow | /ms/ |
| Disallow | /bla/$ |
| Disallow | /%28pre%7Cpost%7Cprepost%29 |
| Disallow | /search |
| Disallow | /bin/images/operator/ |
| Disallow | /common/js/ |
| Disallow | /lastminute |
| Disallow | /buchung |
| Disallow | /gelf |
| Disallow | /api_private/airport |
| Disallow | /comvel-search-interface/rest/productsearch* |
| Disallow | /comvel-hotel-info-service/rest/hotel/info* |
| Disallow | /comvel-datelistsearch-service/rest/datelistsearch* |
| Disallow | /comvel-corecatcher-service |
| Disallow | /comvel-corecatcher-service/rest/corecatcher |
| Disallow | /comvel-holiday-service/ |
| Disallow | /comvel-deeplink-mapper |
| Disallow | /iban-validation-service/ |
| Disallow | /product-service/ |
| Disallow | /comvel-booking-interface/rest/booking2 |
| Disallow | /hotel/*/angebot |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.weg.de/sitemaps/sitemap-rdlp.xml |
| sitemap | https://www.weg.de/sitemaps/sitemap-hdlp.xml |
| sitemap | https://www.weg.de/sitemaps/sitemap-hlp.xml |
| sitemap | https://www.weg.de/sitemaps/sitemap-staedtereisen.xml |
| sitemap | https://www.weg.de/sitemap.xml |