avtorazborki.org
robots.txt

Robots Exclusion Standard data for avtorazborki.org

Resource Scan

Scan Details

Site Domain avtorazborki.org
Base Domain avtorazborki.org
Scan Status Ok
Last Scan2024-09-28T01:21:02+00:00
Next Scan 2024-10-05T01:21:02+00:00

Last Scan

Scanned2024-09-28T01:21:02+00:00
URL https://avtorazborki.org/robots.txt
Domain IPs 77.222.61.153
Response IP 77.222.61.153
Found Yes
Hash 7d82bfd233fea6bbcd8eca2aeeae7c2cb07ef75c1a54b69a644d9ff40e89f102
SimHash 435dd8fef039

Groups

*

Rule Path
Disallow *?id=*
Disallow /search.html
Disallow /user/
Disallow /logout.html
Disallow /registration.html
Disallow /activate.html
Disallow /activate/*
Disallow /recover.html
Disallow /recover/*
Disallow /review/*
Disallow */answered
Disallow */unanswered
Disallow /out.php
Disallow */add.html
Allow /zapros/add.html
Allow /narazbor/add.html
Disallow */new/
Disallow */new.html
Disallow */best/
Disallow */best.html
Disallow */edit.html
Disallow */open.html
Disallow */close.html
Disallow /zapros/close/*
Disallow /narazbor/close/*
Disallow */vrazbore.html
Disallow */vrazbore/*
Disallow */legkovie.html
Disallow */legkovie/*
Disallow */mikroavtobusy/*/*
Disallow */avtobusy/*/*
Disallow */avtobusy/neoplan.html
Disallow */gruzoviki/*/*
Disallow */gruzoviki/daf.html
Disallow */gruzoviki/freightliner.html
Disallow */gruzoviki/hino.html
Disallow */gruzoviki/international.html
Disallow */gruzoviki/jbc.html
Disallow */gruzoviki/tata.html
Disallow */gruzoviki/ud-trucks.html
Disallow */gruzoviki/yuejin.html
Disallow */gruzoviki/belaz.html
Disallow */gruzoviki/zil.html
Disallow */gruzoviki/kamaz.html
Disallow */gruzoviki/kraz.html
Disallow */gruzoviki/ural.html
Disallow /1
Disallow /2
Disallow /3
Disallow /4
Disallow /5
Disallow /6
Disallow /7
Disallow /8
Disallow /9
Disallow */russia/1
Disallow */russia/2
Disallow */russia/3
Disallow */russia/4
Disallow */russia/5
Disallow */russia/6
Disallow */russia/7
Disallow */russia/8
Disallow */russia/9
Disallow */ukraine/1
Disallow */ukraine/2
Disallow */ukraine/3
Disallow */ukraine/4
Disallow */ukraine/5
Disallow */ukraine/6
Disallow */ukraine/7
Disallow */ukraine/8
Disallow */ukraine/9
Disallow */belarus/1
Disallow */belarus/2
Disallow */belarus/3
Disallow */belarus/4
Disallow */belarus/5
Disallow */belarus/6
Disallow */belarus/7
Disallow */belarus/8
Disallow */belarus/9
Disallow */kazakhstan/1
Disallow */kazakhstan/2
Disallow */kazakhstan/3
Disallow */kazakhstan/4
Disallow */kazakhstan/5
Disallow */kazakhstan/6
Disallow */kazakhstan/7
Disallow */kazakhstan/8
Disallow */kazakhstan/9

mail.ru

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandexdirect

Rule Path
Allow /

yandexdirectdyn

Rule Path
Allow /

yandexmobilebot

Rule Path
Allow /

yandexaccessibilitybot

Rule Path
Allow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

rainbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.