i-znatok.ru
robots.txt
Robots Exclusion Standard data for i-znatok.ru
Resource Scan
Scan Details
Site Domain | i-znatok.ru |
Base Domain | i-znatok.ru |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-11-05T22:27:58+00:00 |
Next Scan | 2024-11-12T22:27:58+00:00 |
Last Successful Scan
Scanned | 2023-08-11T17:51:54+00:00 |
URL | https://i-znatok.ru/robots.txt |
Domain IPs | 104.21.35.155, 172.67.177.3, 2606:4700:3031::ac43:b103, 2606:4700:3034::6815:239b |
Response IP | 104.21.35.155 |
Found | Yes |
Hash | f9675adee80c1fe21b460e0466e21315e3a1b21eee41b1293c99ba67042fb31c |
SimHash | 6c450c258b92 |
Groups
*
Rule | Path |
---|---|
Disallow | /*?qa=register |
Disallow | /user |
Disallow | /users |
Disallow | /tags |
Disallow | /tag |
Disallow | /badges |
Disallow | /polls |
Disallow | /chat |
Disallow | /questions |
Disallow | /hot |
Disallow | /unanswered |
Disallow | /categories |
Disallow | /ask |
Disallow | /feed |
Disallow | /login |
Disallow | /logout |
Disallow | /register |
Other Records
Field | Value |
---|---|
sitemap | https://i-znatok.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.