krimfirm.com
robots.txt
Robots Exclusion Standard data for krimfirm.com
Resource Scan
Scan Details
Site Domain | krimfirm.com |
Base Domain | krimfirm.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-05-04T08:41:53+00:00 |
Next Scan | 2024-08-02T08:41:53+00:00 |
Last Successful Scan
Scanned | 2024-01-06T04:49:46+00:00 |
URL | http://krimfirm.com/robots.txt |
Domain IPs | 2a00:15f8:a000:5:1:11:5:b490, 2a00:15f8:a000:5:1:12:5:b490, 2a00:15f8:a000:5:1:13:5:b490, 2a00:15f8:a000:5:1:14:5:b490, 90.156.201.107, 90.156.201.21, 90.156.201.36, 90.156.201.37 |
Response IP | 90.156.201.107 |
Found | Yes |
Hash | 801757e847eca226d3d8eba89c0988b331e0c004ea6666a044aa1d4378e3acaf |
SimHash | 6408b173e093 |
Groups
*
Rule | Path |
---|---|
Disallow | /engine/go.php |
Disallow | /engine/download.php |
Disallow | /user/ |
Disallow | /2014/ |
Disallow | /2015/ |
Disallow | /2016/ |
Disallow | /2017/ |
Disallow | /2018/ |
Disallow | /2019/ |
Disallow | /2020/ |
Disallow | */sevastopolpredprijatija/* |
Disallow | */simferopolpredprijatija/* |
Disallow | */kerchpredprijatija/* |
Disallow | */yaltapredprijatija/* |
Disallow | */evpatoriyapredprijatija/* |
Disallow | */predpriyatiya-krymapredprijatija/* |
Disallow | /tags/ |
Disallow | /newposts/ |
Disallow | /page/ |
Disallow | */page/* |
Disallow | */%7Blink%7D |
Disallow | */xfsearch/* |
Disallow | /statistics.html |
Disallow | /*subaction%3Duserinfo |
Disallow | /*subaction%3Dnewposts |
Disallow | /*do%3Dlastcomments |
Disallow | /*do%3Dfeedback |
Disallow | /*do%3Dregister |
Disallow | /*do%3Dsearch* |
Disallow | /*do%3Dlostpassword |
Disallow | /*do%3Daddnews |
Disallow | /*do%3Dstats |
Disallow | /*do%3Dpm |
Other Records
Field | Value |
---|---|
sitemap | http://krimfirm.com/sitemap.xml |
Warnings
- `host` is not a known field.