klassreferat.ru
robots.txt
Robots Exclusion Standard data for klassreferat.ru
Resource Scan
Scan Details
| Site Domain | klassreferat.ru |
| Base Domain | klassreferat.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-24T08:28:39+00:00 |
| Next Scan | 2025-01-22T08:28:39+00:00 |
Last Successful Scan
| Scanned | 2024-06-27T07:39:45+00:00 |
| URL | https://klassreferat.ru/robots.txt |
| Domain IPs | 88.99.251.199 |
| Response IP | 88.99.251.199 |
| Found | Yes |
| Hash | 9f1465c03c5b113a10125e009e840df8d20a391ac601a2e90b80086d42feca82 |
| SimHash | ab3cdc706192 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /components/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /*?* |
| Disallow | /*?limitstart= |
| Disallow | /?limitstart= |
| Disallow | /*?limit= |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://klassreferat.ru/index.php?option=com_xmap&view=xml&tmpl=component&id=1 |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.