asics.co.id
robots.txt

Robots Exclusion Standard data for asics.co.id

Resource Scan

Scan Details

Site Domain asics.co.id
Base Domain asics.co.id
Scan Status Ok
Last Scan2025-11-02T16:31:47+00:00
Next Scan 2025-11-16T16:31:47+00:00

Last Scan

Scanned2025-11-02T16:31:47+00:00
URL https://asics.co.id/robots.txt
Domain IPs 129.227.71.109, 129.227.71.110
Response IP 129.227.71.109
Found Yes
Hash f404328813009571fe872d9883e0381cdc2f1c96aaa6964563299c266b17a2d7
SimHash 6d145b508a02

Groups

mj12bot
semrushbot
yandex
yandexbot
zoominfobot
um-ln
mtrobot
safednsbot
bytespider
bitlybot
barkrowle
coccocbot-image
petalbot
dotbot
blexbot
aspiegelbot
baiduspider
trovitbot
mail.ru_bot
seznambot
yisouspider
zh-cn
slackbot
slackbot-linkexpanding

Rule Path
Disallow /

*

Rule Path
Disallow /graphql
Disallow /index.php/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /wishlist/
Disallow /admin/
Disallow /review/product/
Disallow /sendfriend/
Disallow /enable-cookies/
Disallow /LICENSE.txt
Disallow /LICENSE.html
Disallow /skin/
Disallow /js/
Disallow /directory/
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pub/
Disallow /tag/
Disallow /review/
Disallow /*?utm_
Disallow /*?&utm_

Other Records

Field Value
sitemap https://asics.co.id/sitemap.xml

Comments

  • Stop crawling user account and checkout pages by search engine robot
  • Blocking native catalog and search pages
  • Blocking CMS directories
  • Blocking duplicate content
  • Blocking UTM
  • Sitemap

Warnings

  • `host` is not a known field.