fsrussia.ru
robots.txt
Robots Exclusion Standard data for fsrussia.ru
Resource Scan
Scan Details
Site Domain | fsrussia.ru |
Base Domain | fsrussia.ru |
Scan Status | Ok |
Last Scan | 2024-05-28T03:50:51+00:00 |
Next Scan | 2024-06-27T03:50:51+00:00 |
Last Scan
Scanned | 2024-05-28T03:50:51+00:00 |
URL | https://fsrussia.ru/robots.txt |
Domain IPs | 31.31.196.216 |
Response IP | 31.31.196.216 |
Found | Yes |
Hash | d2e84b308d7b05023871174dee7c11b177a79fc7455e320cbd76040219ab55c7 |
SimHash | e31e9d5907e5 |
Groups
*
Rule | Path |
---|---|
Disallow | /administrator/ |
Disallow | /bin/ |
Disallow | /cache/ |
Disallow | /cli/ |
Disallow | /components/ |
Disallow | /includes/ |
Disallow | /installation/ |
Disallow | /language/ |
Disallow | /layouts/ |
Disallow | /libraries/ |
Disallow | /logs/ |
Disallow | /media/ |
Disallow | /modules/ |
Disallow | /plugins/ |
Disallow | /templates/ |
Disallow | /tmp/ |
Disallow | /index.php* |
Disallow | /index2.php* |
Allow | /images/ |
Other Records
Field | Value |
---|---|
crawl-delay | 40 |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.
Comments