carsforrent.ru
robots.txt
Robots Exclusion Standard data for carsforrent.ru
Resource Scan
Scan Details
Site Domain | carsforrent.ru |
Base Domain | carsforrent.ru |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-03-15T21:23:53+00:00 |
Next Scan | 2025-06-13T21:23:53+00:00 |
Last Successful Scan
Scanned | 2023-02-02T17:57:45+00:00 |
URL | https://carsforrent.ru/robots.txt |
Domain IPs | 104.21.9.41, 172.67.141.121, 2606:4700:3035::6815:929, 2606:4700:3035::ac43:8d79 |
Response IP | 104.21.9.41 |
Found | Yes |
Hash | 3d944e7c1819ae34309253908a6eb381987895cb6c5b7226cd8062df3e56155b |
SimHash | ef4908100691 |
Groups
*
Rule | Path |
---|---|
Disallow | /bitrix/ |
Disallow | /images/ |
Disallow | /img/ |
Disallow | /imgs/ |
Disallow | /media/ |
Disallow | /plugins/ |
Disallow | /local/ |
Disallow | /avto/transport-12-169/ |
Disallow | /avto/transport-8-15/ |
Disallow | /avto/transport-14-198/ |
Disallow | /arenda-svadebnyh-avtomobilej/ |
Disallow | /?* |
Disallow | /order/ |
Disallow | /business_max/ |
Disallow | /about/news_max/ |
Disallow | /index_b.php |
Disallow | /*?lang_ui= |
Disallow | /*?PAGEN_1= |
Disallow | /*?pn= |
Disallow | /*?utm_banner= |
Disallow | /*/*?utm_banner= |
Disallow | /index_new_b.php |
Disallow | /index_b.php |
Disallow | /Services/ |
Disallow | /anketbv.rtf |
yandex
Rule | Path |
---|---|
Disallow | /bitrix/ |
Disallow | /images/ |
Disallow | /img/ |
Disallow | /imgs/ |
Disallow | /media/ |
Disallow | /plugins/ |
Disallow | /local/ |
Disallow | /avto/transport-12-169/ |
Disallow | /avto/transport-8-15/ |
Disallow | /avto/transport-14-198/ |
Disallow | /arenda-svadebnyh-avtomobilej/ |
Disallow | /?* |
Disallow | /order/ |
Disallow | /business_max/ |
Disallow | /about/news_max/ |
Disallow | /index_b.php |
Disallow | /*?lang_ui= |
Disallow | /*?PAGEN_1= |
Disallow | /*?pn= |
Disallow | /*?utm_banner= |
Disallow | /*/*?utm_banner= |
Disallow | /index_new_b.php |
Disallow | /index_b.php |
Disallow | /Services/ |
Disallow | /anketbv.rtf |
Disallow | /*?__cf_chl_tk=* |
Disallow | /*?__cf_chl* |
Other Records
Field | Value |
---|---|
sitemap | https://www.carsforrent.ru/sitemap.xml |
sitemap | https://www.carsforrent.ru/sitemap.xml |
Warnings
- `host` is not a known field.