avtobazar.ua
robots.txt

Robots Exclusion Standard data for avtobazar.ua

Resource Scan

Scan Details

Site Domain avtobazar.ua
Base Domain avtobazar.ua
Scan Status Ok
Last Scan2024-09-27T21:12:44+00:00
Next Scan 2024-10-04T21:12:44+00:00

Last Scan

Scanned2024-09-27T21:12:44+00:00
URL https://avtobazar.ua/robots.txt
Domain IPs 104.26.2.241, 104.26.3.241, 172.67.74.113, 2606:4700:20::681a:2f1, 2606:4700:20::681a:3f1, 2606:4700:20::ac43:4a71
Response IP 104.26.2.241
Found Yes
Hash 366d7c505de72677668e8bfacb0a38814484dca731241558d6b5e4b4749bba93
SimHash 88203420071b

Groups

*

Rule Path
Allow /assets/*.js
Allow /cdn-cgi/scripts/5c5dd728/cloudflare-static/email-decode.min.js
Allow /assets/*.css
Allow /assets/*.svg
Allow /assets/*.png
Allow /assets/*.svg
Allow /img/*.png
Allow /img/*.svg
Allow /img/*.gif
Allow /img/*.svg
Allow *.png?v2
Allow *.ico?v2
Allow /api/seo-urls/?url=*
Disallow /login/
Disallow /zhurnal/?tag=*
Disallow /zhurnal/*/?tag=*
Disallow /*/zhurnal/*/?tag=*
Disallow /*.pdf
Disallow /*/?abroad=*
Disallow /*/?capacityFrom=*
Disallow /*/?capacityUnit=*
Disallow /*/?ordering=*
Disallow /*/*/?page=1*
Disallow /*/?make=*
Disallow /*/?isNew=*
Disallow /*/?currency=*
Disallow /*/?isOriginal=*
Disallow /*/?isAnalogue=*
Disallow /*/?inStock=*
Disallow /*/?transport=*
Disallow /*/?rubric=*
Disallow /store/seoText/*.html
Disallow /*/?page=*
Disallow /*/?*
Disallow /*/my/
Disallow /poisk/
Disallow /addv2/
Disallow /uk/addv2/
Disallow /uk/service/search-subscriptions/
Disallow /service/search-subscriptions/

Other Records

Field Value
sitemap https://avtobazar.ua/sitemap.xml

Warnings

  • `host` is not a known field.