kakaku.com
robots.txt

Robots Exclusion Standard data for kakaku.com

Resource Scan

Scan Details

Site Domain kakaku.com
Base Domain kakaku.com
Scan Status Ok
Last Scan2024-11-13T21:15:47+00:00
Next Scan 2024-11-20T21:15:47+00:00

Last Scan

Scanned2024-11-13T21:15:47+00:00
URL https://kakaku.com/robots.txt
Domain IPs 103.70.243.165
Response IP 103.70.243.165
Found Yes
Hash ee861f18e398f4a21968afbf875aa62efb48366acb8119792adfe56a1706a69c
SimHash 81188480c171

Groups

*

Rule Path
Allow /auth/profile/
Disallow /ksearch/
Disallow /auth/
Disallow /prdsearch/pricehistory_data/
Disallow /kakakuad/
Disallow /history/
Disallow /jump/
Disallow /ad/
Disallow /ria/
Disallow /item/*/localshops/
Disallow /localshops/shop/*/print/
Disallow /localshops/shop/*/shopitem/
Disallow /kuruma/hoken/
Disallow /kuchikomi/review/history/
Disallow /shopreg/
Disallow /localshopreg/
Disallow /mapsearch/Default.aspx
Disallow /okurimono/script/
Disallow /script/kakakuad/
Disallow /modules/
Disallow /pt/
Disallow /ref/rd_kused.asp
Disallow /card/compare/compare.asp*
Disallow /kuchikomi/review/results/
Disallow /smartphonerd/
Disallow /altitem/
Disallow /error/
Disallow /se.asp
Disallow /prdnews/newssearch/
Disallow /err/
Disallow /*/jump/

mediapartners-google

Rule Path
Allow /kuchikomi/review/history/

bingbot

Rule Path
Allow /auth/profile/
Disallow /ksearch/
Disallow /auth/
Disallow /prdsearch/pricehistory_data/
Disallow /kakakuad/
Disallow /history/
Disallow /jump/
Disallow /ad/
Disallow /ria/
Disallow /item/*/localshops/
Disallow /localshops/shop/*/print/
Disallow /localshops/shop/*/shopitem/
Disallow /kuruma/hoken/
Disallow /kuchikomi/review/history/
Disallow /shopreg/
Disallow /localshopreg/
Disallow /mapsearch/Default.aspx
Disallow /okurimono/script/
Disallow /script/kakakuad/
Disallow /modules/
Disallow /pt/
Disallow /ref/rd_kused.asp
Disallow /card/compare/compare.asp*
Disallow /kuchikomi/review/results/
Disallow /smartphonerd/
Disallow /altitem/
Disallow /error/
Disallow /se.asp
Disallow /prdnews/newssearch/
Disallow /err/
Disallow /used/*?*
Disallow /*/jump/

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /