avtodispetcher.ru
robots.txt
Robots Exclusion Standard data for avtodispetcher.ru
Resource Scan
Scan Details
| Site Domain | avtodispetcher.ru |
| Base Domain | avtodispetcher.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-17T13:47:18+00:00 |
| Next Scan | 2024-09-24T13:47:18+00:00 |
Last Scan
| Scanned | 2024-09-17T13:47:18+00:00 |
| URL | https://avtodispetcher.ru/robots.txt |
| Redirect | https://www.avtodispetcher.ru/robots.txt |
| Redirect Domain | www.avtodispetcher.ru |
| Redirect Base | avtodispetcher.ru |
| Domain IPs | 104.21.72.161, 172.67.153.35, 2606:4700:3034::6815:48a1, 2606:4700:3037::ac43:9923 |
| Redirect IPs | 104.21.72.161, 172.67.153.35, 2606:4700:3034::6815:48a1, 2606:4700:3037::ac43:9923 |
| Response IP | 172.67.153.35 |
| Found | Yes |
| Hash | 7e19c671d4e792f6861f6aec8e49a26344bf7416149886c5aabd203e00554600 |
| SimHash | 4de7e4ea6ab9 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /_img/ |
| Disallow | /tools/ |
| Disallow | /search/ |
| Disallow | /user/ |
| Disallow | /pm/ |
| Disallow | /confirm-email |
| Disallow | /distance/print/ |
| Disallow | /distance/export/frame.php |
| Disallow | /distance/export/mini.php |
| Disallow | /distance/export/mini.html |
| Disallow | /distance/export/joomla/version.ajax.php |
| Disallow | /distance/highway |
| Disallow | /distance/story |
| Disallow | /distance/passenger |
| Disallow | /distance/ridesharing |
| Disallow | /distance/itil |
| Disallow | /distance/hoah |
| Disallow | /distance/kalina |
| Disallow | /distance/goodway |
| Disallow | /distance/pridonie |
| Disallow | /distance/rose |
| Disallow | /distance/night |
| Disallow | /distance/garant |
| Disallow | /distance/getberry |
| Disallow | /distance/avtograph |
| Disallow | /distance/video |
| Disallow | /distance/youtube |
| Disallow | /distance/youtubelink |
| Disallow | /distance/city-with-hotels |
| Disallow | /distance/bookingcom |
| Disallow | /distance/hotel-page |
| Disallow | /distance/hotel-site |
| Disallow | /consignor/lift/ |
| Disallow | /truck/lift/ |
| Disallow | /truck/sms.php |
| Disallow | /consignor/edit.php |
| Disallow | /consignor/edit |
| Disallow | /consignor/add/ |
| Disallow | /consignor/extra |
| Disallow | /consignor/filter |
| Disallow | /consignor/absent |
| Disallow | /consignor/sms.php |
| Disallow | /truck/extra |
| Disallow | /truck/edit.php |
| Disallow | /truck/edit |
| Disallow | /truck/add/ |
| Disallow | /truck/filter |
| Disallow | /company/edit |
| Disallow | /company/truck |
| Disallow | /company/consignor |
| Disallow | /company/forwarder |
| Disallow | /captcha/ |
| Disallow | /icons |
| Disallow | /viaroute.php |
| Disallow | /person-phone/ |
| Disallow | /partnerreview/edit |
| Disallow | /person/account |
| Disallow | /_upload/hotel |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 0.5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.avtodispetcher.ru/sitemap.xml |
Warnings
- `host` is not a known field.