urlaubsziele.com
robots.txt

Robots Exclusion Standard data for urlaubsziele.com

Resource Scan

Scan Details

Site Domain urlaubsziele.com
Base Domain urlaubsziele.com
Scan Status Ok
Last Scan2024-11-07T19:55:36+00:00
Next Scan 2024-11-14T19:55:36+00:00

Last Scan

Scanned2024-11-07T19:55:36+00:00
URL https://urlaubsziele.com/robots.txt
Redirect https://www.urlaubsziele.com/robots.txt
Redirect Domain www.urlaubsziele.com
Redirect Base urlaubsziele.com
Domain IPs 188.40.2.11, 2a01:4f8:d0a:3057::2
Redirect IPs 188.40.2.11, 2a01:4f8:d0a:3057::2
Response IP 188.40.2.11
Found Yes
Hash aeda30c516839ff4bd5545dcf10cf1e2959f1fcfb27c381e8c9599962088b19c
SimHash 4a345cf3c6d4

Groups

audisto

Rule Path
Disallow

googlebot

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

google-sitemaps

Rule Path
Disallow

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 2

msnbot-media

Rule Path
Disallow

Other Records

Field Value
crawl-delay 2

msnbot-newsblogs

Rule Path
Disallow

Other Records

Field Value
crawl-delay 2

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 2

adidxbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 2

slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 2

ia_archiver

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.urlaubsziele.com/sitemap.xml