store.shopping.yahoo.co.jp
robots.txt

Robots Exclusion Standard data for store.shopping.yahoo.co.jp

Resource Scan

Scan Details

Site Domain store.shopping.yahoo.co.jp
Base Domain yahoo.co.jp
Scan Status Ok
Last Scan2024-05-04T06:53:26+00:00
Next Scan 2024-05-18T06:53:26+00:00

Last Scan

Scanned2024-05-04T06:53:26+00:00
URL https://store.shopping.yahoo.co.jp/robots.txt
Domain IPs 183.79.219.252
Response IP 183.79.250.251
Found Yes
Hash c694d9ecd0dd2967b648b46613391de13683356a7d57b23b37cb21a004d1f931
SimHash e851da0ce7d2

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /h_api/
Disallow /*/search.html?strcid=
Disallow /*/search.html?*&strcid=
Disallow /*/search.html?brandid=
Disallow /*/search.html?*&brandid=
Disallow /*/search.html?kspec*=
Disallow /*/search.html?*&kspec*=
Disallow /*/search.html?spec*=
Disallow /*/search.html?*&spec*=
Disallow /*/search.html?pt=
Disallow /*/search.html?*&pt=
Disallow /*/search.html?pf=
Disallow /*/search.html?*&pf=
Disallow /syene-bff/v1/view-history?
Disallow /*/item_image_gallery.html