shop.adidas.jp
robots.txt

Robots Exclusion Standard data for shop.adidas.jp

Resource Scan

Scan Details

Site Domain shop.adidas.jp
Base Domain adidas.jp
Scan Status Ok
Last Scan2024-05-27T17:31:23+00:00
Next Scan 2024-06-26T17:31:23+00:00

Last Scan

Scanned2024-05-27T17:31:23+00:00
URL https://shop.adidas.jp/robots.txt
Domain IPs 211.14.1.65
Response IP 211.14.1.65
Found Yes
Hash fde6c19aa3f43bd69c24a5f41d6ea93612a78f89ee8515f5ef1f5726b23f0247
SimHash 444ec6a0e111

Groups

baiduspider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

waseda_koba_bot

Rule Path
Disallow /

openhosebot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

deusu

Rule Path
Disallow /

*

Rule Path
Disallow /item/?*q=b*
Disallow /item/?*q=B*
Disallow /item/?*sizeCode=*%7C*
Disallow /item/?*price=*%7C*
Disallow /item/?*itemClgr=*%7C*
Disallow /item/?*athlete=*%7C*
Disallow /item/?*best_for=*%7C*
Disallow /item/?*brand=*%7C*
Disallow /item/?*gender=*%7C*
Disallow /item/?*closure=*%7C*
Disallow /item/?*collection=*%7C*
Disallow /item/?*condition=*%7C*
Disallow /item/?*fit=*%7C*
Disallow /item/?*group=*%7C*
Disallow /item/?*material=*%7C*
Disallow /item/?*sleve_length=*%7C*
Disallow /item/?*sport=*%7C*
Disallow /item/?*surface=*%7C*
Disallow /item/?*sustainable=*%7C*
Disallow /item/?*team=*%7C*
Disallow /item/?*technology=*%7C*
Disallow /item/?*type=*%7C*
Disallow /pc/nl/mod/
Disallow /pc/nl/mailmag.cgi
Disallow /pc/secure/cust/member/*
Disallow /secure/cust/member/*

Other Records

Field Value
sitemap https://shop.adidas.jp/adidas_sitemap_index.xml

Warnings

  • 1 invalid line.