ellegirl.ru
robots.txt

Robots Exclusion Standard data for ellegirl.ru

Resource Scan

Scan Details

Site Domain ellegirl.ru
Base Domain ellegirl.ru
Scan Status Ok
Last Scan2024-05-25T11:09:51+00:00
Next Scan 2024-06-01T11:09:51+00:00

Last Scan

Scanned2024-05-25T11:09:51+00:00
URL https://ellegirl.ru/robots.txt
Redirect https://thegirl.ru/robots.txt
Redirect Domain thegirl.ru
Redirect Base thegirl.ru
Domain IPs 195.226.222.200
Redirect IPs 195.226.222.200
Response IP 195.226.222.200
Found Yes
Hash d35e05aec936cad52fe605bdb44bc03b26b67ebc2e677bf65771e0282f9bf548
SimHash 79150a47dc93

Groups

zen_bot/2.0

Rule Path
Allow *?utm_source=
Allow *?from=
Allow /rss-feeds/yanews.xml

yandexnews

Rule Path
Allow */yanews/
Allow /rss/yandex/
Allow *?from=yanews
Allow *?utm_source=
Allow /rss-feeds/yanews.xml

*

Rule Path
Disallow /search/*
Disallow /admin/*
Disallow /users/*
Disallow /profile/*
Disallow /battles/*%26post*
Disallow /tests/*%26post*
Disallow /polls/*%26post*
Disallow /test/*%26post*
Disallow /?s*
Disallow /?showtopic*
Disallow /*?act=findpost
Disallow /forum/*?act=findpost
Disallow /*_openstat
Disallow /*from%3Dadwords
Disallow *?previewToken=*
Disallow /*utm_source%3D
Disallow *scroogePreview_creativeId%3D
Disallow /gm-api/*
Disallow */?$
Disallow /?
Disallow */result/*
Disallow *?type=
Disallow *?noredir=
Disallow /ellegirls/
Disallow /looks/
Disallow /video/
Disallow /news/
Disallow /horoscopes/
Disallow /polls/
Disallow /battles/
Disallow */%26
Disallow *?_ShowPlaces=
Disallow /tag/*/www.
Disallow */?game=
Disallow *?iu=
Disallow *%26gdfp_req%3D
Disallow *%26lineItemId%3D
Disallow *%26creativeId%3D
Disallow */?no_header=
Disallow */?open
Disallow */?utm
Disallow */yanews/
Disallow */?continueFlag=
Disallow /pages/tos/
Disallow /pages/tot/
Disallow /pages/polzovatelskoe-soglashenie/
Disallow /competitions/
Disallow /articles/nu-privet-prednovogodnii-syurpriz/
Disallow /articles/bonusy-zimy-kak-podnyat-sebe-nastroenie-kogda-solnce-skazalo-poka/
Disallow /gm-api/
Disallow /81006599/
Disallow /22729373807/

Other Records

Field Value
sitemap https://thegirl.ru/sitemaps/index.xml.gz

Warnings

  • `clean-param` is not a known field.