автосоюз.рф
robots.txt

Robots Exclusion Standard data for автосоюз.рф

Resource Scan

Scan Details

Site Domain автосоюз.рф
Base Domain автосоюз.рф
Scan Status Ok
Last Scan2024-09-09T01:11:27+00:00
Next Scan 2024-10-09T01:11:27+00:00

Last Scan

Scanned2024-09-09T01:11:27+00:00
URL https://автосоюз.рф/robots.txt
Redirect https://xn--80aep1aarf3h.xn--p1ai/robots.txt
Domain IPs 45.93.202.2
Response IP 45.93.202.2
Found Yes
Hash f2d03a63c4b6c6857e5abfdad223300375e371ad26d64b3fe6373010087b9eea
SimHash 50ce47d34889

Groups

*

Rule Path
Allow /*
Disallow /search/
Disallow /Search/
Disallow /account/
Disallow /Account/
Disallow /Basket/
Disallow /CaptchaImage/
Disallow /Cars/
Disallow /ClientInfo/
Disallow /ClientOffice/
Disallow /commercial/
Disallow /Crosses/
Disallow /Discount/
Disallow /DefectiveDetails/
Disallow /Error/
Disallow /favicon
Disallow /Feedback/
Disallow /Finances/
Disallow /HelpBox/
Disallow /History/
Disallow /Image/
Disallow /Mui/
Disallow /Notification/
Disallow /Orders/
Disallow /PotentialArticle/
Disallow /refund/
Disallow /uploadToBasket/
Disallow /Vin/
Disallow /slideShow/
Disallow /Category/Comparation/
Disallow /Category/AddToComparation/
Disallow /Category/DeleteFromComparation/
Disallow /Category/ComparationInfo/
Disallow /RussianCars/
Disallow /Content/Page/66
Disallow /Content/Page/65
Disallow /CatalogsOnlineAndPDF/
Disallow /totalcatalog/
Disallow /Products/CategoryProducts/

googlebot-image

Rule Path
Allow /*

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

riddler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ninja-crawler

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /AutoParts/GetPageAutoParts
Disallow /autoparts/GetPageAutoParts
Disallow /RussianCars/GetPage
Disallow /russiancars/GetPage

Other Records

Field Value
sitemap https://xn--80aep1aarf3h.xn--p1ai/sitemap.xml

Warnings

  • `host` is not a known field.