forekc.ru
robots.txt
Robots Exclusion Standard data for forekc.ru
Resource Scan
Scan Details
Site Domain | forekc.ru |
Base Domain | forekc.ru |
Scan Status | Ok |
Last Scan | 2024-09-30T21:26:04+00:00 |
Next Scan | 2024-10-07T21:26:04+00:00 |
Last Scan
Scanned | 2024-09-30T21:26:04+00:00 |
URL | http://forekc.ru/robots.txt |
Domain IPs | 2a00:f940:1:1:2::655, 31.31.199.214 |
Response IP | 31.31.199.214 |
Found | Yes |
Hash | 12f7e58f5c95cba1499909c12198c0d23d7d712200c7809208e10c9432200f3a |
SimHash | 29180c04cf94 |
Groups
*
Rule | Path |
---|---|
Disallow | /shp/ |
Disallow | /shp/cart.php |
Disallow | /shp/sort.php |
Disallow | /shp/search.php |
Other Records
Field | Value |
---|---|
crawl-delay | 9 |
Other Records
Field | Value |
---|---|
sitemap | http://www.forekc.ru/sitemap1.xml |
sitemap | http://www.forekc.ru/sitemap2.xml |