hotels-scanner.com
robots.txt
Robots Exclusion Standard data for hotels-scanner.com
Resource Scan
Scan Details
Site Domain | hotels-scanner.com |
Base Domain | hotels-scanner.com |
Scan Status | Ok |
Last Scan | 2025-09-22T08:20:29+00:00 |
Next Scan | 2025-09-29T08:20:29+00:00 |
Last Scan
Scanned | 2025-09-22T08:20:29+00:00 |
URL | https://hotels-scanner.com/robots.txt |
Domain IPs | 104.21.1.81, 172.67.128.222, 2606:4700:3035::ac43:80de, 2606:4700:3036::6815:151 |
Response IP | 104.21.1.81 |
Found | Yes |
Hash | a7614cca376ad8f4f2a939ca92f6603cabe0554f934beff24129e19060503a69 |
SimHash | 5e1c46404681 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /?* |
Disallow | /*?* |
Disallow | /frontend.* |
Disallow | /flutter.* |
Disallow | /lang.* |
yandex
Rule | Path |
---|---|
Allow | / |
Allow | /ar$ |
Allow | /bg$ |
Allow | /ca$ |
Allow | /cz$ |
Allow | /cs$ |
Allow | /da$ |
Allow | /nl$ |
Allow | /en$ |
Allow | /et$ |
Allow | /fi$ |
Allow | /fr$ |
Allow | /de$ |
Allow | /id$ |
Allow | /it$ |
Allow | /ja$ |
Allow | /el$ |
Allow | /ru$ |
Allow | /he$ |
Allow | /hu$ |
Allow | /lv$ |
Allow | /lt$ |
Allow | /ko$ |
Allow | /ms$ |
Allow | /no$ |
Allow | /pt$ |
Allow | /pl$ |
Allow | /ro$ |
Allow | /es$ |
Allow | /sv$ |
Allow | /th$ |
Allow | /tr$ |
Allow | /tw$ |
Allow | /uk$ |
Allow | /vi$ |
Disallow | /?* |
Disallow | /*?* |
Disallow | /ar/* |
Disallow | /bg/* |
Disallow | /ca/* |
Disallow | /cz/* |
Disallow | /cs/* |
Disallow | /da/* |
Disallow | /nl/* |
Disallow | /et/* |
Disallow | /fi/* |
Disallow | /fr/* |
Disallow | /de/* |
Disallow | /id/* |
Disallow | /it/* |
Disallow | /ja/* |
Disallow | /el/* |
Disallow | /he/* |
Disallow | /hu/* |
Disallow | /lv/* |
Disallow | /lt/* |
Disallow | /ko/* |
Disallow | /ms/* |
Disallow | /no/* |
Disallow | /pt/* |
Disallow | /pl/* |
Disallow | /ro/* |
Disallow | /es/* |
Disallow | /sv/* |
Disallow | /th/* |
Disallow | /tw/* |
Disallow | /uk/* |
Disallow | /vi/* |
Other Records
Field | Value |
---|---|
sitemap | https://hotels-scanner.com/sitemap.xml |
Warnings
- `host` is not a known field.