avtobazar.ua
robots.txt
Robots Exclusion Standard data for avtobazar.ua
Resource Scan
Scan Details
Site Domain | avtobazar.ua |
Base Domain | avtobazar.ua |
Scan Status | Ok |
Last Scan | 2024-11-09T03:21:08+00:00 |
Next Scan | 2024-11-16T03:21:08+00:00 |
Last Scan
Scanned | 2024-11-09T03:21:08+00:00 |
URL | https://avtobazar.ua/robots.txt |
Domain IPs | 104.26.2.241, 104.26.3.241, 172.67.74.113, 2606:4700:20::681a:2f1, 2606:4700:20::681a:3f1, 2606:4700:20::ac43:4a71 |
Response IP | 104.26.2.241 |
Found | Yes |
Hash | 366d7c505de72677668e8bfacb0a38814484dca731241558d6b5e4b4749bba93 |
SimHash | 88203420071b |
Groups
*
Rule | Path |
---|---|
Allow | /assets/*.js |
Allow | /cdn-cgi/scripts/5c5dd728/cloudflare-static/email-decode.min.js |
Allow | /assets/*.css |
Allow | /assets/*.svg |
Allow | /assets/*.png |
Allow | /assets/*.svg |
Allow | /img/*.png |
Allow | /img/*.svg |
Allow | /img/*.gif |
Allow | /img/*.svg |
Allow | *.png?v2 |
Allow | *.ico?v2 |
Allow | /api/seo-urls/?url=* |
Disallow | /login/ |
Disallow | /zhurnal/?tag=* |
Disallow | /zhurnal/*/?tag=* |
Disallow | /*/zhurnal/*/?tag=* |
Disallow | |
Disallow | /*/?abroad=* |
Disallow | /*/?capacityFrom=* |
Disallow | /*/?capacityUnit=* |
Disallow | /*/?ordering=* |
Disallow | /*/*/?page=1* |
Disallow | /*/?make=* |
Disallow | /*/?isNew=* |
Disallow | /*/?currency=* |
Disallow | /*/?isOriginal=* |
Disallow | /*/?isAnalogue=* |
Disallow | /*/?inStock=* |
Disallow | /*/?transport=* |
Disallow | /*/?rubric=* |
Disallow | /store/seoText/*.html |
Disallow | /*/?page=* |
Disallow | /*/?* |
Disallow | /*/my/ |
Disallow | /poisk/ |
Disallow | /addv2/ |
Disallow | /uk/addv2/ |
Disallow | /uk/service/search-subscriptions/ |
Disallow | /service/search-subscriptions/ |
Other Records
Field | Value |
---|---|
sitemap | https://avtobazar.ua/sitemap.xml |
Warnings
- `host` is not a known field.