meiers-weltreisen.de
robots.txt

Robots Exclusion Standard data for meiers-weltreisen.de

Resource Scan

Scan Details

Site Domain meiers-weltreisen.de
Base Domain meiers-weltreisen.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-28T18:39:03+00:00
Next Scan 2024-07-27T18:39:03+00:00

Last Successful Scan

Scanned2023-10-02T16:02:25+00:00
URL https://meiers-weltreisen.de/robots.txt
Redirect https://www.meiers-weltreisen.de/robots.txt
Redirect Domain www.meiers-weltreisen.de
Redirect Base meiers-weltreisen.de
Domain IPs 213.244.192.70, 213.244.192.73
Redirect IPs 213.244.192.70, 213.244.192.73
Response IP 213.244.192.73
Found Yes
Hash 0af329c99e05560c553c25227cc9dee2678b5ac3bac5fb4537df65213f661c83
SimHash 2d5d8c89c053

Groups

*

Rule Path
Disallow /xchg/*
Disallow /darwin/*
Disallow /rest/*
Disallow /reisestelle

mj12bot

Rule Path
Disallow /ibe/*

cliqzbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.meiers-weltreisen.de/sitemaps/sitemap.xml
sitemap https://www.meiers-weltreisen.de/sitemaps/productsitemap.xml