monotaro.com
robots.txt
Robots Exclusion Standard data for monotaro.com
Resource Scan
Scan Details
| Site Domain | monotaro.com |
| Base Domain | monotaro.com |
| Scan Status | Ok |
| Last Scan | 2024-09-25T01:07:38+00:00 |
| Next Scan | 2024-10-09T01:07:38+00:00 |
Last Scan
| Scanned | 2024-09-25T01:07:38+00:00 |
| URL | https://monotaro.com/robots.txt |
| Redirect | https://www.monotaro.com/robots.txt |
| Redirect Domain | www.monotaro.com |
| Redirect Base | monotaro.com |
| Domain IPs | 108.156.133.102, 108.156.133.111, 108.156.133.27, 108.156.133.64 |
| Redirect IPs | 23.36.49.2 |
| Response IP | 23.54.56.252 |
| Found | Yes |
| Hash | 45285bd74326f54fce80650863072a160e0ffefcc4d496e278aa357f23de9a81 |
| SimHash | 41112043d4b3 |
Groups
*
adsbot-google
bingbot
msnbot
bingpreview
chatgpt-user
| Rule | Path |
|---|---|
| Disallow | /monotaroMain.py |
| Disallow | /boughtItem/ |
| Disallow | /mypage/ |
| Disallow | /jsm/ |
| Disallow | /k/promote/ |
| Disallow | /s/s-brand/ |
| Disallow | /cgi-bin/ |
| Disallow | /mws/ |
| Disallow | /sca/ |
| Disallow | /s/c/_ |
| Disallow | /p/*/*/?display_id=26 |
| Disallow | /p/*/*/?t.* |
| Disallow | /g/*/?t.* |
| Disallow | /g/*/?q=* |
| Disallow | /g/*/?attr_* |
| Disallow | /analyze/ |
| Disallow | /s/sp/ |
| Disallow | /k/sp/ |
| Disallow | /s/fl/ |
| Disallow | /topic/po/*/ |
| Disallow | /smc-cad/ |
| Disallow | /mitsubishi/login |
| Disallow | /cad/ |
| Disallow | /selection/ |
| Disallow | /bp*/b-*%2C* |
| Disallow | /bp/b-*/?b=* |
| Disallow | /bp/c-*/b-*/?b* |
| Disallow | /s/*abolition%3D* |
| Disallow | /s/*rv%3D* |
| Disallow | /s/*pf%3D* |
| Disallow | /s/*pt%3D* |
| Disallow | /s/*subscribe%3D* |
| Disallow | /s/*si%3D* |
| Disallow | /s/c-*/b-*%0A*/ |
| Disallow | /s/c-*/attr_f*/q-* |
| Disallow | /s/s-attr_f*/?* |
| Disallow | /common/js/system/nop/* |
| Disallow | /sp/common/js/system/nop/* |
| Disallow | /common/dest/smartphoneSuggest-min.js |
| Disallow | /api/recent_view_history/ |
| Disallow | /api/notice/ |
| Disallow | /api/ship_info/ |
| Disallow | /api/basket/ |
| Disallow | /user/info/mail/* |
| Disallow | /user/register/mail/* |
| Disallow | /api/item/* |
| Allow | /api/item/*/search?* |
| Allow | /monotaroMain.py?func=monotaro.loginForm.showFormServlet.ShowFormServlet |
| Disallow | /metrics/g/collect/?v* |