avtodriveexpert.ru
robots.txt
Robots Exclusion Standard data for avtodriveexpert.ru
Resource Scan
Scan Details
| Site Domain | avtodriveexpert.ru |
| Base Domain | avtodriveexpert.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-03-26T13:07:26+00:00 |
| Next Scan | 2024-06-24T13:07:26+00:00 |
Last Successful Scan
| Scanned | 2023-11-05T13:05:14+00:00 |
| URL | http://www.avtodriveexpert.ru/robots.txt |
| Domain IPs | 104.21.94.139, 172.67.136.139, 2606:4700:3030::ac43:888b, 2606:4700:3036::6815:5e8b |
| Response IP | 172.67.136.139 |
| Found | Yes |
| Hash | a1a1c0ca01f5b1301cbefcccb050d01e10ad18db4d27318b11a0a02c15793a67 |
| SimHash | 8d455e67c190 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /city |
| Disallow | /faq |
| Disallow | /zvonok_ok |
| Disallow | /oplata_i_dostavka |
| Disallow | /documenty |
| Disallow | /otzivy |
| Disallow | /contacts |
| Disallow | /?admin |
Other Records
| Field | Value |
|---|---|
| sitemap | https://avtodriveexpert.ru/sitemap.php |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.