avtoshara.kiev.ua
robots.txt

Robots Exclusion Standard data for avtoshara.kiev.ua

Resource Scan

Scan Details

Site Domain avtoshara.kiev.ua
Base Domain avtoshara.kiev.ua
Scan Status Ok
Last Scan2024-09-16T17:15:53+00:00
Next Scan 2024-09-30T17:15:53+00:00

Last Scan

Scanned2024-09-16T17:15:53+00:00
URL https://avtoshara.kiev.ua/robots.txt
Domain IPs 185.233.39.102
Response IP 185.233.39.102
Found Yes
Hash 0c1fd669bef26eb98884ab90321a1dac5bda032a2ebea6615067af136ed27571
SimHash 4c50dee34674

Groups

*

Rule Path
Disallow /*%26sort%3D*
Disallow /admin.php
Disallow /*filtrs*
Disallow /*pricef*
Disallow /*pricet*
Disallow /access_admin.php
Disallow /pricelist
Disallow /pay/
Disallow /pay/*
Disallow /payo/
Disallow /payo/*
Disallow /search_expanded/
Disallow /*searchstring%3D
Disallow /*%26clearf%3D1
Disallow /index.php?pages=
Disallow /go.php
Disallow /*utm_
Disallow /*_openstat
Disallow /*gclid%3D
Disallow /login.html
Disallow /ua/login.html
Disallow /user.html
Disallow /ua/user.html
Disallow /edituser.html
Disallow /ua/edituser.html

ninjabot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

Comments

  • Robots.txt file for https://avtoshara.kiev.ua
  • Disallow: /*/add2cart/*
  • Disallow: /add2cart

Warnings

  • `host` is not a known field.