mt-shirot.com
robots.txt
Robots Exclusion Standard data for mt-shirot.com
Resource Scan
Scan Details
| Site Domain | mt-shirot.com |
| Base Domain | mt-shirot.com |
| Scan Status | Ok |
| Last Scan | 2025-10-31T04:39:23+00:00 |
| Next Scan | 2025-11-14T04:39:23+00:00 |
Last Scan
| Scanned | 2025-10-31T04:39:23+00:00 |
| URL | https://mt-shirot.com/robots.txt |
| Domain IPs | 104.21.16.207, 172.67.215.236, 2606:4700:3032::6815:10cf, 2606:4700:3037::ac43:d7ec |
| Response IP | 104.21.16.207 |
| Found | Yes |
| Hash | c4dd9841ba20937557392231e1cf2952a87ca74dcaa14274607802f6143d8176 |
| SimHash | c67dcf62da11 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /iframe |
| Disallow | /signup/register |
| Disallow | /signup |
| Disallow | /login |
| Disallow | /logout |
| Disallow | /cart |
| Disallow | /mypage |
| Disallow | /reset_password |
| Disallow | /forgot_password |
| Disallow | /checkout |
| Disallow | /checkout_paypal |
| Disallow | /checkout_carrier |
| Disallow | /checkout_amazon_pay |
| Disallow | /checkout_rakuten_pay |
| Disallow | /checkout_rakuten_pay_error |
| Disallow | /checkout_paypay |
| Disallow | /checkout/callback/* |
| Disallow | /checkout/status/* |
| Disallow | /checkout/complete/* |
| Disallow | /items/*/image_gallery |
| Disallow | /orders |
| Disallow | /tokushoho |
| Disallow | /search |
| Disallow | /hashtag/* |
| Disallow | /web/pomelo/refresh |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |