jp.mercari.com
robots.txt

Robots Exclusion Standard data for jp.mercari.com

Resource Scan

Scan Details

Site Domain jp.mercari.com
Base Domain mercari.com
Scan Status Ok
Last Scan2024-06-20T08:10:54+00:00
Next Scan 2024-07-04T08:10:54+00:00

Last Scan

Scanned2024-06-20T08:10:54+00:00
URL https://jp.mercari.com/robots.txt
Domain IPs 104.18.37.23, 172.64.150.233
Response IP 104.18.37.23
Found Yes
Hash 582baa91cf43f5e28ec177ef547fe38886f592799b2e6494ecc2087733abc798
SimHash 504086a0cb8b

Groups

*

Rule Path
Allow /en$
Disallow /en/
Allow /ko$
Disallow /ko/
Allow /zh-TW$
Disallow /zh-TW/
Disallow /mypage/
Disallow /purchase/
Disallow /sell/
Disallow /transaction/
Disallow /v1/
Disallow /v2/

twitterbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

facebookcatalog

Rule Path
Allow /

Warnings

  • `host` is not a known field.