chemer.ru
robots.txt
Robots Exclusion Standard data for chemer.ru
Resource Scan
Scan Details
| Site Domain | chemer.ru |
| Base Domain | chemer.ru |
| Scan Status | Ok |
| Last Scan | 2024-06-20T06:27:42+00:00 |
| Next Scan | 2024-06-27T06:27:42+00:00 |
Last Scan
| Scanned | 2024-06-20T06:27:42+00:00 |
| URL | https://chemer.ru/robots.txt |
| Domain IPs | 104.21.3.92, 172.67.130.136, 2606:4700:3030::ac43:8288, 2606:4700:3032::6815:35c |
| Response IP | 104.21.3.92 |
| Found | Yes |
| Hash | 07985574e6cfded0da4299a306ad2c4b5f7142c7a1540bf6cdb2a738a77fd188 |
| SimHash | 2725565cc192 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *?* |
| Disallow | /otvet/ |
| Disallow | /online/ |
| Disallow | /reshebniki/ |
| Disallow | /spravochnik/ |
| Disallow | /tipovye/ |
| Disallow | /cdn-cgi/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://chemer.ru/template/sitemap.xml |
Warnings
- `host` is not a known field.