youloveit.ru
robots.txt

Robots Exclusion Standard data for youloveit.ru

Resource Scan

Scan Details

Site Domain youloveit.ru
Base Domain youloveit.ru
Scan Status Ok
Last Scan2024-11-08T21:30:54+00:00
Next Scan 2024-11-15T21:30:54+00:00

Last Scan

Scanned2024-11-08T21:30:54+00:00
URL https://youloveit.ru/robots.txt
Redirect https://www.youloveit.ru/robots.txt
Redirect Domain www.youloveit.ru
Redirect Base youloveit.ru
Domain IPs 157.90.230.170
Redirect IPs 157.90.230.170
Response IP 157.90.230.170
Found Yes
Hash 88270c2465e622d18b902ce61d7cf0b5397d3c9df303f6bfc163c5b5fbd9ba3f
SimHash 2d198c510631

Groups

*

Rule Path
Disallow /engine/go.php
Disallow /engine/download.php
Disallow /user/
Disallow /newposts/
Disallow /statistics.html
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*do%3Dsearch
Disallow /*print
Disallow /*action%3Dmobile
Disallow /2008/
Disallow /2009/
Disallow /2010/
Disallow /2011/
Disallow /2012/
Disallow /2013/
Disallow /2014/
Disallow /2015/
Disallow /2016/
Disallow /2017/
Disallow /2018/
Disallow /2019/
Disallow /2020/
Disallow /2021/
Disallow /2022/
Disallow /gallery/all/
Disallow /*do%3Dgallery%26jump
Disallow /*do%3Dgallery%26act%3D15
Disallow /*act%3D15
Disallow /*do%3Dgallery%26act%3D4
Disallow /*do%3Dgallery%26jc%3D
Disallow /*%26jump%3Dnext
Disallow /*%26jump%3Dprevious
Disallow /*engine/gallery/external/download.php

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.youloveit.ru/sitemap.xml

Warnings

  • `host` is not a known field.