nehitro.ru
robots.txt
Robots Exclusion Standard data for nehitro.ru
Resource Scan
Scan Details
| Site Domain | nehitro.ru |
| Base Domain | nehitro.ru |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2025-04-04T21:04:42+00:00 |
| Next Scan | 2025-06-03T21:04:42+00:00 |
Last Successful Scan
| Scanned | 2025-02-04T20:25:54+00:00 |
| URL | http://nehitro.ru/robots.txt |
| Domain IPs | 91.236.136.97 |
| Response IP | 91.236.136.97 |
| Found | Yes |
| Hash | ade8c09ddc7ddbfedb2cb031b975fff15f9298b4b630b751e9ba9c918527480a |
| SimHash | 365c9220ef30 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *.jpg |
| Disallow | *.gif |
| Disallow | *.png |
| Disallow | *feed |
| Disallow | *feed/ |
| Disallow | /author/* |
| Disallow | /author/ |
| Disallow | /2014/ |
| Disallow | /2014/* |
| Disallow | /2015/ |
| Disallow | /2015/* |
| Disallow | */tag/* |
| Disallow | /sample-page? |
| Disallow | /*?p |
| Disallow | /*?cat |
| Disallow | */page/* |
| Disallow | /*?page_id |
| Disallow | /xmlrpc.php |
Other Records
| Field | Value |
|---|---|
| sitemap | http://nehitro.ru/sitemap.xml.gz |
Warnings
- `host` is not a known field.
- `sallow` is not a known field.