as-it.ua
robots.txt
Robots Exclusion Standard data for as-it.ua
Resource Scan
Scan Details
Site Domain | as-it.ua |
Base Domain | as-it.ua |
Scan Status | Ok |
Last Scan | 2024-09-26T05:45:04+00:00 |
Next Scan | 2024-10-26T05:45:04+00:00 |
Last Scan
Scanned | 2024-09-26T05:45:04+00:00 |
URL | https://as-it.ua/robots.txt |
Domain IPs | 104.21.20.146, 172.67.193.34, 2606:4700:3032::ac43:c122, 2606:4700:3033::6815:1492 |
Response IP | 104.21.20.146 |
Found | Yes |
Hash | 7e9dcf8a2f9b75c6aed4c328b40580cde12df3413937f80e2c9b0cba866acd7d |
SimHash | 703c23436ef3 |
Groups
*
Rule | Path |
---|---|
Allow | /*.css |
Allow | /*.js |
Allow | /*.jpg |
Allow | /*.jpeg |
Allow | /*.gif |
Allow | /*.png |
Allow | /*.svg |
Allow | /*.webp |
Allow | /*.ttf |
Allow | /*.woff |
Allow | /*.woff2 |
Disallow | /*route%3Daccount/ |
Disallow | /*route%3Daffiliate/ |
Disallow | /*route%3Dcheckout/ |
Disallow | /*account/ |
Disallow | /*logout/ |
Disallow | /*create/ |
Disallow | /*checkout-order |
Disallow | /*simplecheckout/ |
Disallow | /*edit/ |
Disallow | /*change-password/ |
Disallow | /*address-book/ |
Disallow | /*wishlist/ |
Disallow | /*newsletter/ |
Disallow | /*history/ |
Disallow | /*downloads/ |
Disallow | /*returns/ |
Disallow | /*transactions/ |
Disallow | /*forgot/ |
Disallow | /admin/ |
Disallow | /download |
Disallow | /system |
Disallow | /prom |
Disallow | /rozetka |
Disallow | /*login/ |
Disallow | /*search/* |
Disallow | /*order%3D |
Disallow | /*tracking%3D |
Disallow | /*sort%3D |
Disallow | /*?prs%5B*%5D= |
Disallow | /*%26prs%5B*%5D%3D |
Disallow | /*?psp%5B*%5D= |
Disallow | /*%26psp%5B*%5D%3D |
Disallow | /*?optv%5B*%5D= |
Disallow | /*%26optv%5B*%5D%3D |
Disallow | /*?qnts%5B*%5D= |
Disallow | /*%26qnts%5B*%5D%3D |
Disallow | /*?nows%5B*%5D= |
Disallow | /*%26nows%5B*%5D%3D |
Disallow | /*.xls |
Disallow | /*.doc |
Disallow | /*.docx |
Disallow |
Other Records
Field | Value |
---|---|
sitemap | https://as-it.ua/ua/sitemap.xml |
sitemap | https://as-it.ua/ru/sitemap.xml |
Warnings
- 12 invalid lines.
- `host` is not a known field.