42it.ru
robots.txt
Robots Exclusion Standard data for 42it.ru
Resource Scan
Scan Details
| Site Domain | 42it.ru |
| Base Domain | 42it.ru |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-11-02T23:30:42+00:00 |
| Next Scan | 2024-11-16T23:30:42+00:00 |
Last Successful Scan
| Scanned | 2024-09-25T23:29:37+00:00 |
| URL | http://42it.ru/robots.txt |
| Domain IPs | 213.110.60.166 |
| Response IP | 213.110.60.166 |
| Found | Yes |
| Hash | f9df0c810fc6a4ef7ded8ce5360c7dd3e2198ab899a8feceef2d55ef63c67bea |
| SimHash | ab2cc57863d8 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /components/ |
| Disallow | /images/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |