hotels-inn.de
robots.txt

Robots Exclusion Standard data for hotels-inn.de

Resource Scan

Scan Details

Site Domain hotels-inn.de
Base Domain hotels-inn.de
Scan Status Ok
Last Scan2025-05-27T12:22:29+00:00
Next Scan 2025-06-26T12:22:29+00:00

Last Scan

Scanned2025-05-27T12:22:29+00:00
URL https://hotels-inn.de/robots.txt
Redirect https://www.hotels-inn.de/robots.txt
Redirect Domain www.hotels-inn.de
Redirect Base hotels-inn.de
Domain IPs 104.21.31.206, 172.67.179.244, 2606:4700:3033::6815:1fce, 2606:4700:3033::ac43:b3f4
Redirect IPs 104.21.31.206, 172.67.179.244, 2606:4700:3033::6815:1fce, 2606:4700:3033::ac43:b3f4
Response IP 104.21.31.206
Found Yes
Hash 5ade4b3e9ed90af0e766dfa9ef95561711d62feb77d825a2dcb1375acb9e3d88
SimHash 566541d0cfc8

Groups

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

npbot-1/2.0

Rule Path
Disallow /

npbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

linespider

Rule Path
Disallow /

infotigerbot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

admantx

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

amazon-kendra-web-crawler-*

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

*

Rule Path
Disallow /pub/
Disallow /inc/
Disallow /action/
Disallow /autosearch/
Disallow /policies/