krimfirm.com
robots.txt

Robots Exclusion Standard data for krimfirm.com

Resource Scan

Scan Details

Site Domain krimfirm.com
Base Domain krimfirm.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-05-04T08:41:53+00:00
Next Scan 2024-08-02T08:41:53+00:00

Last Successful Scan

Scanned2024-01-06T04:49:46+00:00
URL http://krimfirm.com/robots.txt
Domain IPs 2a00:15f8:a000:5:1:11:5:b490, 2a00:15f8:a000:5:1:12:5:b490, 2a00:15f8:a000:5:1:13:5:b490, 2a00:15f8:a000:5:1:14:5:b490, 90.156.201.107, 90.156.201.21, 90.156.201.36, 90.156.201.37
Response IP 90.156.201.107
Found Yes
Hash 801757e847eca226d3d8eba89c0988b331e0c004ea6666a044aa1d4378e3acaf
SimHash 6408b173e093

Groups

*

Rule Path
Disallow /engine/go.php
Disallow /engine/download.php
Disallow /user/
Disallow /2014/
Disallow /2015/
Disallow /2016/
Disallow /2017/
Disallow /2018/
Disallow /2019/
Disallow /2020/
Disallow */sevastopolpredprijatija/*
Disallow */simferopolpredprijatija/*
Disallow */kerchpredprijatija/*
Disallow */yaltapredprijatija/*
Disallow */evpatoriyapredprijatija/*
Disallow */predpriyatiya-krymapredprijatija/*
Disallow /tags/
Disallow /newposts/
Disallow /page/
Disallow */page/*
Disallow */%7Blink%7D
Disallow */xfsearch/*
Disallow /statistics.html
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dsearch*
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm

Other Records

Field Value
sitemap http://krimfirm.com/sitemap.xml

Warnings

  • `host` is not a known field.