jp.mercari.com
robots.txt
Robots Exclusion Standard data for jp.mercari.com
Resource Scan
Scan Details
Site Domain | jp.mercari.com |
Base Domain | mercari.com |
Scan Status | Ok |
Last Scan | 2024-06-20T08:10:54+00:00 |
Next Scan | 2024-07-04T08:10:54+00:00 |
Last Scan
Scanned | 2024-06-20T08:10:54+00:00 |
URL | https://jp.mercari.com/robots.txt |
Domain IPs | 104.18.37.23, 172.64.150.233 |
Response IP | 104.18.37.23 |
Found | Yes |
Hash | 582baa91cf43f5e28ec177ef547fe38886f592799b2e6494ecc2087733abc798 |
SimHash | 504086a0cb8b |
Groups
*
Rule | Path |
---|---|
Allow | /en$ |
Disallow | /en/ |
Allow | /ko$ |
Disallow | /ko/ |
Allow | /zh-TW$ |
Disallow | /zh-TW/ |
Disallow | /mypage/ |
Disallow | /purchase/ |
Disallow | /sell/ |
Disallow | /transaction/ |
Disallow | /v1/ |
Disallow | /v2/ |
Warnings
- `host` is not a known field.