myguidebook.ru
robots.txt

Robots Exclusion Standard data for myguidebook.ru

Resource Scan

Scan Details

Site Domain myguidebook.ru
Base Domain myguidebook.ru
Scan Status Ok
Last Scan2024-06-13T06:04:25+00:00
Next Scan 2024-06-20T06:04:25+00:00

Last Scan

Scanned2024-06-13T06:04:25+00:00
URL https://myguidebook.ru/robots.txt
Domain IPs 104.21.71.62, 172.67.169.254
Response IP 172.67.169.254
Found Yes
Hash 424353546a0fc32248d7bed3f66646ee706d5f54c442beb36544cb1a2879a2c4
SimHash 0b0a50135f94

Groups

*

Rule Path
Disallow /se/
Disallow /search
Disallow /y_search
Disallow /alert.php
Disallow /mail.php
Disallow /go.php
Disallow /catalog/search
Disallow /catalog/search-cat
Disallow /catalog/country/
Disallow /catalog/region/
Disallow /catalog/city/
Disallow /catalog/map-ajax/
Disallow /hotels/json/
Disallow /user/edit/mod/
Disallow /airports/json/
Disallow /ajax-hotel.php

msnbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

msnbot-media

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

yahoo! slurp

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://myguidebook.ru/sitemap/index.xml
sitemap https://myguidebook.ru/sitemap/cat/list_index.xml