domik65.ru
robots.txt
Robots Exclusion Standard data for domik65.ru
Resource Scan
Scan Details
Site Domain | domik65.ru |
Base Domain | domik65.ru |
Scan Status | Ok |
Last Scan | 2024-10-06T02:18:45+00:00 |
Next Scan | 2024-10-13T02:18:45+00:00 |
Last Scan
Scanned | 2024-10-06T02:18:45+00:00 |
URL | https://domik65.ru/robots.txt |
Domain IPs | 104.21.27.197, 172.67.169.163, 2606:4700:3034::ac43:a9a3, 2606:4700:3037::6815:1bc5 |
Response IP | 172.67.169.163 |
Found | Yes |
Hash | 1e1c6be7871a39cbffc3be0d2ebb882149e5fb36e77a8385b6ff5549b57f3e9f |
SimHash | ec189026e5b3 |
Groups
*
Rule | Path |
---|---|
Disallow | *.gif |
Disallow | /notes* |
Disallow | /my* |
Disallow | /add* |
Disallow | /api* |
Disallow | /edit* |
Disallow | /*/competitive |
Disallow | /*/renew |
Disallow | /*/overLimit |
Disallow | /*rlogin%3D* |
Disallow | /*print%3D* |
Disallow | /*utm* |
Disallow | /*%26t%3D* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Warnings
- `clean-param` is not a known field.
Comments