toreba.plus
robots.txt

Robots Exclusion Standard data for toreba.plus

Resource Scan

Scan Details

Site Domain toreba.plus
Base Domain toreba.plus
Scan Status Ok
Last Scan2024-09-20T02:59:06+00:00
Next Scan 2024-09-27T02:59:06+00:00

Last Scan

Scanned2024-09-20T02:59:06+00:00
URL https://toreba.plus/robots.txt
Domain IPs 104.21.66.55, 172.67.201.79, 2606:4700:3033::6815:4237, 2606:4700:3034::ac43:c94f
Response IP 172.67.201.79
Found Yes
Hash 7e4d7e11c04c78b8a0917b64f9bf98c80005b110a418469fc5548bc08ae0536a
SimHash 5e0071591ac7

Groups

*

Rule Path
Allow /*.js*
Allow /*.css*
Allow /*.png*
Allow /*.jpg*
Allow /*.gif*
Disallow /*?*
Allow /bootstrap.min.js
Allow /jquery-3.3.1.js
Allow /jquery.dataTables.min.js
Allow /logo.png
Allow /popper.min.js
Allow /dataTables.bootstrap4.min.js
Allow /bootstrap.css
Allow /dataTables.bootstrap4.min.css

baiduspider

Rule Path
Disallow */product-red/
Disallow */product-red*
Disallow /*/retail/availability*
Disallow /*/retail/availabilitySearch*
Disallow /*/retail/pickupEligibility*
Disallow /*/shop/*WebObjects/*
Disallow /*/shop/1-800-MY-APPLE/*
Disallow /*/shop/2322-consumer*
Disallow /*/shop/account/setup*
Disallow /*/shop/answer/vote*
Disallow /*/shop/browse/campaigns/mobile_overlay*
Disallow /*/shop/browse/overlay*
Disallow /*/shop/button_availability*
Disallow /*/shop/bag*
Disallow /*/shop/change_password*
Disallow /*/shop/checkout*
Disallow /*/shop/create_account*
Disallow /*/shop/favorites*
Disallow /*/shop/identify_user*
Disallow /*/shop/mobile/checkout/start*
Disallow /*/shop/mobilex/*
Disallow /*shop/np/order*
Disallow /*shop/np/giftorguestorder*
Disallow /*shop/np/sign_in*
Disallow /*/shop/question/answer/report*
Disallow /*/shop/question/subscribe*
Disallow /*/shop/question/unsubscribe/*
Disallow /*/shop/review/vote*
Disallow /*/shop/reviews/report*
Disallow /*/shop/rs-mvt/rel/*
Disallow /*/shop/sentry*
Disallow /*/shop/sentryx/change_password*
Disallow /*/shop/sentryx/create_account*
Disallow /*/shop/sentryx/create_account_confirm*
Disallow /*/shop/sentryx/identify_user*
Disallow /*/shop/sentryx/sign_in*
Disallow /*/shop/signed_in_account*
Disallow /*/shop/sign_in*
Disallow /*/shop/sign_out*
Disallow /*/shop/socialsharing/*
Disallow /*/shop/storeConfig*
Disallow /*/shop/vieworder*
Disallow /today*
Disallow /*/variationSelection*
Disallow /ae/*
Disallow /am/*
Disallow /apple-watch-nike/
Disallow /apple-watch-hermes/
Disallow /asia/*
Disallow /at/*
Disallow /au/*
Disallow /befr/*
Disallow /benl/*
Disallow /bg/*
Disallow /bh/*
Disallow /br/*
Disallow /bw/*
Disallow /ca/*
Disallow /ca/fr/*
Disallow /cf/*
Disallow /chde/*
Disallow /chfr/*
Disallow /ci/*
Disallow /cl/*
Disallow /cm/*
Disallow /cn/*/aow/*
Disallow /cn_cmb/*
Disallow /cn_abc/*
Disallow /cn_icbc/*
Disallow /cn_ccb_*
Disallow /cn_cmb_*
Disallow /cn_abc_*
Disallow /cn_icbc_*
Disallow /cn_ccb_*
Disallow /*_kiosk*/shop/
Disallow /co/*
Disallow /cz/*
Disallow /de/*
Disallow /dk/*
Disallow /ee/*
Disallow /eg/*
Disallow /es/*
Disallow /fi/*
Disallow /fr/*
Disallow /gn/*
Disallow /gq/*
Disallow /go/awards/*
Disallow /gr/*
Disallow /gw/*
Disallow /hk/*
Disallow /hk/en/*
Disallow /hk-zh/*
Disallow /hr/*
Disallow /hu/*
Disallow /id/*
Disallow /ie/*
Disallow /il/*
Disallow /in/*
Disallow /it/*
Disallow /jo/*
Disallow /jp/*
Disallow /ke/*
Disallow /kr/*
Disallow /kw/*
Disallow /la/*
Disallow /lae/*
Disallow /li/*
Disallow /lt/*
Disallow /lu/*
Disallow /lv/*
Disallow /ma/*
Disallow /md/*
Disallow /me/*
Disallow /mg/*
Disallow /mk/*
Disallow /ml/*
Disallow /mo/*
Disallow /mt/*
Disallow /mu/*
Disallow /mx/*
Disallow /my/*
Disallow /mz/*
Disallow /ne/*
Disallow /newsroom*
Disallow /ng/*
Disallow /nl/*
Disallow /no/*
Disallow /nz/*
Disallow /om/*
Disallow /ph/*
Disallow /pl/*
Disallow /pt/*
Disallow /qa/*
Disallow /retail/availability*
Disallow /retail/availabilitySearch*
Disallow /retail/pickupEligibility*
Disallow /ro/*
Disallow /ru/*
Disallow /sa/*
Disallow /se/*
Disallow /sg/*
Disallow /shop/*
Disallow /si/*
Disallow /sk/*
Disallow /sn/*
Disallow /today*
Disallow /th/*
Disallow /th-en/*
Disallow /tmall/*
Disallow /tn/*
Disallow /tr/*
Disallow /tw/*
Disallow /ug/*
Disallow /uk/*
Disallow /vn/*
Disallow /za/*

haosouspider

Rule Path
Disallow */product-red/
Disallow /*/retail/availability*
Disallow /*/retail/availabilitySearch*
Disallow /*/retail/pickupEligibility*
Disallow /*/shop/*WebObjects/*
Disallow /*/shop/1-800-MY-APPLE/*
Disallow /*/shop/2322-consumer*
Disallow /*/shop/account/setup*
Disallow /*/shop/answer/vote*
Disallow /*/shop/browse/campaigns/mobile_overlay*
Disallow /*/shop/button_availability*
Disallow /*/shop/bag*
Disallow /*/shop/change_password*
Disallow /*/shop/checkout*
Disallow /*/shop/create_account*
Disallow /*/shop/favorites*
Disallow /*/shop/identify_user*
Disallow /*/shop/mobile/checkout/start*
Disallow /*/shop/mobilex/*
Disallow /*shop/np/order*
Disallow /*shop/np/giftorguestorder*
Disallow /*shop/np/sign_in*
Disallow /*/shop/question/answer/report*
Disallow /*/shop/question/subscribe*
Disallow /*/shop/question/unsubscribe/*
Disallow /*/shop/review/vote*
Disallow /*/shop/reviews/report*
Disallow /*/shop/rs-mvt/rel/*
Disallow /*/shop/sentry*
Disallow /*/shop/sentryx/change_password*
Disallow /*/shop/sentryx/create_account*
Disallow /*/shop/sentryx/create_account_confirm*
Disallow /*/shop/sentryx/identify_user*
Disallow /*/shop/sentryx/sign_in*
Disallow /*/shop/signed_in_account*
Disallow /*/shop/sign_in*
Disallow /*/shop/sign_out*
Disallow /*/shop/socialsharing/*
Disallow /*/shop/storeConfig*
Disallow /*/shop/variationSelection*
Disallow /*/shop/vieworder*
Disallow /apple-watch-nike/
Disallow /apple-watch-hermes/
Disallow /cn/*/aow/*
Disallow /newsroom/notifications/*
Disallow /retail/availability*
Disallow /retail/availabilitySearch*
Disallow /retail/pickupEligibility*
Disallow /shop/bag*
Disallow /shop/search/*
Disallow /tmall/*
Disallow /cn_cmb/*
Disallow /cn_abc/*
Disallow /cn_icbc/*
Disallow /cn_ccb_*
Disallow /cn_cmb_*
Disallow /cn_abc_*
Disallow /cn_icbc_*
Disallow /cn_ccb_*

sogou web spider

Rule Path
Disallow /*
Allow /cn/*
Allow /cn-k12/*

sogou inst spider

Rule Path
Disallow /*
Allow /cn/*
Allow /cn-k12/*

sogou spider2

Rule Path
Disallow /*
Allow /cn/*
Allow /cn-k12/*