moscowmap.ru
robots.txt

Robots Exclusion Standard data for moscowmap.ru

Resource Scan

Scan Details

Site Domain moscowmap.ru
Base Domain moscowmap.ru
Scan Status Ok
Last Scan2024-11-12T15:49:32+00:00
Next Scan 2024-11-19T15:49:32+00:00

Last Scan

Scanned2024-11-12T15:49:32+00:00
URL https://moscowmap.ru/robots.txt
Redirect https://www.moscowmap.ru/robots.txt
Redirect Domain www.moscowmap.ru
Redirect Base moscowmap.ru
Domain IPs 84.201.143.67
Redirect IPs 84.201.143.67
Response IP 84.201.143.67
Found Yes
Hash a11eda0326d6db5c2c5c33132ff1772af3facbac4a83aebb1d9e8c4744330417
SimHash 4766a4044504

Groups

msn

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

petalbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

mediapartners-google

Rule Path
Disallow

Other Records

Field Value
crawl-delay 1

*

Rule Path
Allow /rss/
Disallow /realty?*
Disallow /realty/rent-*
Disallow /realty/sale-*
Disallow /realty-quest*
Disallow /realty/?*
Disallow /search*
Disallow /search-route*
Disallow /disadr/*
Disallow /around.php
Disallow /howtoget-details.php
Disallow /rabota/
Disallow /*.swf$
Disallow /urxeiltem/
Disallow /sprav2/vip
Disallow /_ajax/
Disallow /news/filter/
Disallow /news/society/
Disallow /news/events/
Disallow /news/city/
Disallow /news/transport/
Disallow /proezd.php?*
Disallow /dostoprimechatelnosti-moskvy/filter/*
Disallow /soft/
Disallow /cabinet*
Disallow /welcome*
Disallow /travel/cultural-life/page*
Disallow /travel/amusement/page*
Disallow /travel/outdoor-activity/page*
Disallow /travel/where-to-stay/page*
Disallow /travel/food-place/page*
Disallow /_adv/*
Disallow *?*pwa=
Disallow *?*mosmetromap=

Warnings

  • `host` is not a known field.