tabor.ru
robots.txt

Robots Exclusion Standard data for tabor.ru

Resource Scan

Scan Details

Site Domain tabor.ru
Base Domain tabor.ru
Scan Status Ok
Last Scan2024-11-07T03:28:20+00:00
Next Scan 2024-11-14T03:28:20+00:00

Last Scan

Scanned2024-11-07T03:28:20+00:00
URL https://tabor.ru/robots.txt
Domain IPs 185.12.124.71, 185.12.125.94
Response IP 185.12.125.94
Found Yes
Hash 83669f7f6eae2b387ee55bce6b14e1f23ff31b828130edd17a4cd63213bafed0
SimHash 6250e943c913

Groups

yandex

Rule Path
Disallow /users/*
Disallow /services/*
Disallow /signin?*
Disallow /*redirect_page
Disallow /albums/*
Disallow /horoscope/*
Disallow /shop/cart*
Disallow /feed_votes*
Disallow /feed/*?t=fb&u=
Disallow /feed/*?t=vk&u=
Disallow /feed/*?t=ok&u=
Disallow /redirects*
Disallow /votes*

*

Rule Path
Disallow /users/*
Disallow /services/*
Disallow /*redirect_page
Disallow /signin?*
Disallow /albums/*
Disallow /horoscope/*
Disallow /shop/cart*
Disallow /feed_votes*
Disallow /feed/*?t=fb&u=
Disallow /feed/*?t=vk&u=
Disallow /feed/*?t=ok&u=
Disallow /redirects*
Disallow /votes*

mj12bot

Rule Path
Disallow

Other Records

Field Value
sitemap https://tabor.ru/sitemap.xml
sitemap https://tabor.ru/sitemap.xml

Warnings

  • `host` is not a known field.