hotels-scanner.com
robots.txt

Robots Exclusion Standard data for hotels-scanner.com

Resource Scan

Scan Details

Site Domain hotels-scanner.com
Base Domain hotels-scanner.com
Scan Status Ok
Last Scan2025-09-22T08:20:29+00:00
Next Scan 2025-09-29T08:20:29+00:00

Last Scan

Scanned2025-09-22T08:20:29+00:00
URL https://hotels-scanner.com/robots.txt
Domain IPs 104.21.1.81, 172.67.128.222, 2606:4700:3035::ac43:80de, 2606:4700:3036::6815:151
Response IP 104.21.1.81
Found Yes
Hash a7614cca376ad8f4f2a939ca92f6603cabe0554f934beff24129e19060503a69
SimHash 5e1c46404681

Groups

*

Rule Path
Allow /
Disallow /?*
Disallow /*?*
Disallow /frontend.*
Disallow /flutter.*
Disallow /lang.*

yandex

Rule Path
Allow /
Allow /ar$
Allow /bg$
Allow /ca$
Allow /cz$
Allow /cs$
Allow /da$
Allow /nl$
Allow /en$
Allow /et$
Allow /fi$
Allow /fr$
Allow /de$
Allow /id$
Allow /it$
Allow /ja$
Allow /el$
Allow /ru$
Allow /he$
Allow /hu$
Allow /lv$
Allow /lt$
Allow /ko$
Allow /ms$
Allow /no$
Allow /pt$
Allow /pl$
Allow /ro$
Allow /es$
Allow /sv$
Allow /th$
Allow /tr$
Allow /tw$
Allow /uk$
Allow /vi$
Disallow /?*
Disallow /*?*
Disallow /ar/*
Disallow /bg/*
Disallow /ca/*
Disallow /cz/*
Disallow /cs/*
Disallow /da/*
Disallow /nl/*
Disallow /et/*
Disallow /fi/*
Disallow /fr/*
Disallow /de/*
Disallow /id/*
Disallow /it/*
Disallow /ja/*
Disallow /el/*
Disallow /he/*
Disallow /hu/*
Disallow /lv/*
Disallow /lt/*
Disallow /ko/*
Disallow /ms/*
Disallow /no/*
Disallow /pt/*
Disallow /pl/*
Disallow /ro/*
Disallow /es/*
Disallow /sv/*
Disallow /th/*
Disallow /tw/*
Disallow /uk/*
Disallow /vi/*

Other Records

Field Value
sitemap https://hotels-scanner.com/sitemap.xml

Warnings

  • `host` is not a known field.