bheroland.ru
robots.txt

Robots Exclusion Standard data for bheroland.ru

Resource Scan

Scan Details

Site Domain bheroland.ru
Base Domain bheroland.ru
Scan Status Ok
Last Scan2024-09-28T02:59:14+00:00
Next Scan 2024-10-05T02:59:14+00:00

Last Scan

Scanned2024-09-28T02:59:14+00:00
URL https://bheroland.ru/robots.txt
Domain IPs 188.225.43.200, 2a03:6f00:4::23b0
Response IP 188.225.43.200
Found Yes
Hash 8b7b2c3a652b0341a8709ab5f5aa0fbf6c842b57a48ff9c16101256bcd7c9382
SimHash 311da5ffaa13

Groups

*

Rule Path
Disallow /out/
Disallow /user/
Disallow /cache/
Disallow /engine/
Disallow /language/
Disallow /templates/
Disallow /favorites/
Disallow /backup/
Disallow /lastnews/
Disallow /catalog/
Disallow /addnews/
Disallow /stats/
Disallow /newposts/
Disallow /tags/
Disallow /static/
Disallow /addnews.html
Disallow /rules.html
Disallow /statistics.html
Disallow /*?*
Disallow /*/print*
Disallow /*print
Disallow /2009/
Disallow /2010/
Disallow /2011/
Disallow /2012/
Disallow /2013/
Disallow /2014/
Disallow /2015/
Disallow /2016/
Disallow /2017/
Disallow /2018/
Disallow /2019/
Disallow /2020/
Disallow /engine/redirect.php
Disallow /rss.xml
Disallow /engine/go.php

mail.ru

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10