toreba.plus
robots.txt
Robots Exclusion Standard data for toreba.plus
Resource Scan
Scan Details
Site Domain | toreba.plus |
Base Domain | toreba.plus |
Scan Status | Ok |
Last Scan | 2024-11-08T04:06:58+00:00 |
Next Scan | 2024-11-15T04:06:58+00:00 |
Last Scan
Scanned | 2024-11-08T04:06:58+00:00 |
URL | https://toreba.plus/robots.txt |
Domain IPs | 104.21.66.55, 172.67.201.79, 2606:4700:3033::6815:4237, 2606:4700:3034::ac43:c94f |
Response IP | 104.21.66.55 |
Found | Yes |
Hash | 7e4d7e11c04c78b8a0917b64f9bf98c80005b110a418469fc5548bc08ae0536a |
SimHash | 5e0071591ac7 |
Groups
*
Rule | Path |
---|---|
Allow | /*.js* |
Allow | /*.css* |
Allow | /*.png* |
Allow | /*.jpg* |
Allow | /*.gif* |
Disallow | /*?* |
Allow | /bootstrap.min.js |
Allow | /jquery-3.3.1.js |
Allow | /jquery.dataTables.min.js |
Allow | /logo.png |
Allow | /popper.min.js |
Allow | /dataTables.bootstrap4.min.js |
Allow | /bootstrap.css |
Allow | /dataTables.bootstrap4.min.css |
baiduspider
Rule | Path |
---|---|
Disallow | */product-red/ |
Disallow | */product-red* |
Disallow | /*/retail/availability* |
Disallow | /*/retail/availabilitySearch* |
Disallow | /*/retail/pickupEligibility* |
Disallow | /*/shop/*WebObjects/* |
Disallow | /*/shop/1-800-MY-APPLE/* |
Disallow | /*/shop/2322-consumer* |
Disallow | /*/shop/account/setup* |
Disallow | /*/shop/answer/vote* |
Disallow | /*/shop/browse/campaigns/mobile_overlay* |
Disallow | /*/shop/browse/overlay* |
Disallow | /*/shop/button_availability* |
Disallow | /*/shop/bag* |
Disallow | /*/shop/change_password* |
Disallow | /*/shop/checkout* |
Disallow | /*/shop/create_account* |
Disallow | /*/shop/favorites* |
Disallow | /*/shop/identify_user* |
Disallow | /*/shop/mobile/checkout/start* |
Disallow | /*/shop/mobilex/* |
Disallow | /*shop/np/order* |
Disallow | /*shop/np/giftorguestorder* |
Disallow | /*shop/np/sign_in* |
Disallow | /*/shop/question/answer/report* |
Disallow | /*/shop/question/subscribe* |
Disallow | /*/shop/question/unsubscribe/* |
Disallow | /*/shop/review/vote* |
Disallow | /*/shop/reviews/report* |
Disallow | /*/shop/rs-mvt/rel/* |
Disallow | /*/shop/sentry* |
Disallow | /*/shop/sentryx/change_password* |
Disallow | /*/shop/sentryx/create_account* |
Disallow | /*/shop/sentryx/create_account_confirm* |
Disallow | /*/shop/sentryx/identify_user* |
Disallow | /*/shop/sentryx/sign_in* |
Disallow | /*/shop/signed_in_account* |
Disallow | /*/shop/sign_in* |
Disallow | /*/shop/sign_out* |
Disallow | /*/shop/socialsharing/* |
Disallow | /*/shop/storeConfig* |
Disallow | /*/shop/vieworder* |
Disallow | /today* |
Disallow | /*/variationSelection* |
Disallow | /ae/* |
Disallow | /am/* |
Disallow | /apple-watch-nike/ |
Disallow | /apple-watch-hermes/ |
Disallow | /asia/* |
Disallow | /at/* |
Disallow | /au/* |
Disallow | /befr/* |
Disallow | /benl/* |
Disallow | /bg/* |
Disallow | /bh/* |
Disallow | /br/* |
Disallow | /bw/* |
Disallow | /ca/* |
Disallow | /ca/fr/* |
Disallow | /cf/* |
Disallow | /chde/* |
Disallow | /chfr/* |
Disallow | /ci/* |
Disallow | /cl/* |
Disallow | /cm/* |
Disallow | /cn/*/aow/* |
Disallow | /cn_cmb/* |
Disallow | /cn_abc/* |
Disallow | /cn_icbc/* |
Disallow | /cn_ccb_* |
Disallow | /cn_cmb_* |
Disallow | /cn_abc_* |
Disallow | /cn_icbc_* |
Disallow | /cn_ccb_* |
Disallow | /*_kiosk*/shop/ |
Disallow | /co/* |
Disallow | /cz/* |
Disallow | /de/* |
Disallow | /dk/* |
Disallow | /ee/* |
Disallow | /eg/* |
Disallow | /es/* |
Disallow | /fi/* |
Disallow | /fr/* |
Disallow | /gn/* |
Disallow | /gq/* |
Disallow | /go/awards/* |
Disallow | /gr/* |
Disallow | /gw/* |
Disallow | /hk/* |
Disallow | /hk/en/* |
Disallow | /hk-zh/* |
Disallow | /hr/* |
Disallow | /hu/* |
Disallow | /id/* |
Disallow | /ie/* |
Disallow | /il/* |
Disallow | /in/* |
Disallow | /it/* |
Disallow | /jo/* |
Disallow | /jp/* |
Disallow | /ke/* |
Disallow | /kr/* |
Disallow | /kw/* |
Disallow | /la/* |
Disallow | /lae/* |
Disallow | /li/* |
Disallow | /lt/* |
Disallow | /lu/* |
Disallow | /lv/* |
Disallow | /ma/* |
Disallow | /md/* |
Disallow | /me/* |
Disallow | /mg/* |
Disallow | /mk/* |
Disallow | /ml/* |
Disallow | /mo/* |
Disallow | /mt/* |
Disallow | /mu/* |
Disallow | /mx/* |
Disallow | /my/* |
Disallow | /mz/* |
Disallow | /ne/* |
Disallow | /newsroom* |
Disallow | /ng/* |
Disallow | /nl/* |
Disallow | /no/* |
Disallow | /nz/* |
Disallow | /om/* |
Disallow | /ph/* |
Disallow | /pl/* |
Disallow | /pt/* |
Disallow | /qa/* |
Disallow | /retail/availability* |
Disallow | /retail/availabilitySearch* |
Disallow | /retail/pickupEligibility* |
Disallow | /ro/* |
Disallow | /ru/* |
Disallow | /sa/* |
Disallow | /se/* |
Disallow | /sg/* |
Disallow | /shop/* |
Disallow | /si/* |
Disallow | /sk/* |
Disallow | /sn/* |
Disallow | /today* |
Disallow | /th/* |
Disallow | /th-en/* |
Disallow | /tmall/* |
Disallow | /tn/* |
Disallow | /tr/* |
Disallow | /tw/* |
Disallow | /ug/* |
Disallow | /uk/* |
Disallow | /vn/* |
Disallow | /za/* |
haosouspider
Rule | Path |
---|---|
Disallow | */product-red/ |
Disallow | /*/retail/availability* |
Disallow | /*/retail/availabilitySearch* |
Disallow | /*/retail/pickupEligibility* |
Disallow | /*/shop/*WebObjects/* |
Disallow | /*/shop/1-800-MY-APPLE/* |
Disallow | /*/shop/2322-consumer* |
Disallow | /*/shop/account/setup* |
Disallow | /*/shop/answer/vote* |
Disallow | /*/shop/browse/campaigns/mobile_overlay* |
Disallow | /*/shop/button_availability* |
Disallow | /*/shop/bag* |
Disallow | /*/shop/change_password* |
Disallow | /*/shop/checkout* |
Disallow | /*/shop/create_account* |
Disallow | /*/shop/favorites* |
Disallow | /*/shop/identify_user* |
Disallow | /*/shop/mobile/checkout/start* |
Disallow | /*/shop/mobilex/* |
Disallow | /*shop/np/order* |
Disallow | /*shop/np/giftorguestorder* |
Disallow | /*shop/np/sign_in* |
Disallow | /*/shop/question/answer/report* |
Disallow | /*/shop/question/subscribe* |
Disallow | /*/shop/question/unsubscribe/* |
Disallow | /*/shop/review/vote* |
Disallow | /*/shop/reviews/report* |
Disallow | /*/shop/rs-mvt/rel/* |
Disallow | /*/shop/sentry* |
Disallow | /*/shop/sentryx/change_password* |
Disallow | /*/shop/sentryx/create_account* |
Disallow | /*/shop/sentryx/create_account_confirm* |
Disallow | /*/shop/sentryx/identify_user* |
Disallow | /*/shop/sentryx/sign_in* |
Disallow | /*/shop/signed_in_account* |
Disallow | /*/shop/sign_in* |
Disallow | /*/shop/sign_out* |
Disallow | /*/shop/socialsharing/* |
Disallow | /*/shop/storeConfig* |
Disallow | /*/shop/variationSelection* |
Disallow | /*/shop/vieworder* |
Disallow | /apple-watch-nike/ |
Disallow | /apple-watch-hermes/ |
Disallow | /cn/*/aow/* |
Disallow | /newsroom/notifications/* |
Disallow | /retail/availability* |
Disallow | /retail/availabilitySearch* |
Disallow | /retail/pickupEligibility* |
Disallow | /shop/bag* |
Disallow | /shop/search/* |
Disallow | /tmall/* |
Disallow | /cn_cmb/* |
Disallow | /cn_abc/* |
Disallow | /cn_icbc/* |
Disallow | /cn_ccb_* |
Disallow | /cn_cmb_* |
Disallow | /cn_abc_* |
Disallow | /cn_icbc_* |
Disallow | /cn_ccb_* |