mercari.com
robots.txt

Robots Exclusion Standard data for mercari.com

Resource Scan

Scan Details

Site Domain mercari.com
Base Domain mercari.com
Scan Status Ok
Last Scan2024-06-03T05:28:45+00:00
Next Scan 2024-06-17T05:28:45+00:00

Last Scan

Scanned2024-06-03T05:28:45+00:00
URL https://mercari.com/robots.txt
Redirect https://www.mercari.com/robots.txt
Redirect Domain www.mercari.com
Redirect Base mercari.com
Domain IPs 108.157.254.123, 108.157.254.59, 108.157.254.72, 108.157.254.75
Redirect IPs 104.18.39.11, 172.64.148.245
Response IP 104.18.39.11
Found Yes
Hash 0d6796cf56f09ab28aaff8884954a53478e8c08cfdcafd816a187e0b102cdfdb
SimHash 2b41ae77a312

Groups

adsbot-google-mobile
googlebot-image
adsbot-google

Rule Path
Allow /

googlebot

Rule Path
Disallow /tos/
Disallow /privacy/
Disallow /w9/
Disallow /reauthenticate/
Disallow /password/reset/*
Disallow /email_confirmation/done/
Disallow /id_verification/
Disallow /us/agreements/
Disallow /security_notifications/feedback/
Disallow /us/authorized-reseller/signup/
Disallow /consent/
Disallow /transaction/
Disallow /transaction/*
Disallow /transaction/*/*
Disallow /express-checkout/
Disallow /express-checkout/*
Disallow /sell/
Disallow /sell/*
Disallow /sell/*/*
Disallow /sell/*/*/*
Disallow /us/selling/
Disallow /us/selling/*
Disallow /u/
Disallow /u/*
Disallow /u/*/*
Disallow /mypage/
Disallow /mypage/*
Disallow /mypage/listings/*
Disallow /mypage/listings/draft/*
Disallow /mypage/sales/*
Disallow /mypage/sales/history/*
Disallow /mypage/purchase/
Disallow /mypage/purchase/*
Disallow /mypage/chat/
Disallow /mypage/chat/*
Disallow /mypage/chat/*/*
Disallow /notification-settings/
Disallow /us/gift-card-exchange/
Disallow /favorites/
Disallow /favorites/*
Disallow /news/
Disallow /news/*
Disallow /us/personal_data/*
Disallow /jp/tos/
Disallow /jp/privacy/
Disallow /jp/tokutei/
Disallow /jp/box/

bingbot

Rule Path
Disallow /tos/
Disallow /privacy/
Disallow /w9/
Disallow /reauthenticate/
Disallow /password/reset/*
Disallow /email_confirmation/done/
Disallow /id_verification/
Disallow /us/agreements/
Disallow /security_notifications/feedback/
Disallow /us/authorized-reseller/signup/
Disallow /consent/
Disallow /transaction/
Disallow /transaction/*
Disallow /transaction/*/*
Disallow /express-checkout/
Disallow /express-checkout/*
Disallow /sell/
Disallow /sell/*
Disallow /sell/*/*
Disallow /sell/*/*/*
Disallow /us/selling/
Disallow /us/selling/*
Disallow /u/
Disallow /u/*
Disallow /u/*/*
Disallow /mypage/
Disallow /mypage/*
Disallow /mypage/listings/*
Disallow /mypage/listings/draft/*
Disallow /mypage/sales/*
Disallow /mypage/sales/history/*
Disallow /mypage/purchase/
Disallow /mypage/purchase/*
Disallow /mypage/chat/
Disallow /mypage/chat/*
Disallow /mypage/chat/*/*
Disallow /notification-settings/
Disallow /us/gift-card-exchange/
Disallow /favorites/
Disallow /favorites/*
Disallow /news/
Disallow /news/*
Disallow /us/personal_data/*
Disallow /jp/tos/
Disallow /jp/privacy/
Disallow /jp/tokutei/
Disallow /jp/box/

yandexbot

Rule Path
Disallow /tos/
Disallow /privacy/
Disallow /w9/
Disallow /reauthenticate/
Disallow /password/reset/*
Disallow /email_confirmation/done/
Disallow /id_verification/
Disallow /us/agreements/
Disallow /security_notifications/feedback/
Disallow /us/authorized-reseller/signup/
Disallow /consent/
Disallow /transaction/
Disallow /transaction/*
Disallow /transaction/*/*
Disallow /express-checkout/
Disallow /express-checkout/*
Disallow /sell/
Disallow /sell/*
Disallow /sell/*/*
Disallow /sell/*/*/*
Disallow /us/selling/
Disallow /us/selling/*
Disallow /u/
Disallow /u/*
Disallow /u/*/*
Disallow /mypage/
Disallow /mypage/*
Disallow /mypage/listings/*
Disallow /mypage/listings/draft/*
Disallow /mypage/sales/*
Disallow /mypage/sales/history/*
Disallow /mypage/purchase/
Disallow /mypage/purchase/*
Disallow /mypage/chat/
Disallow /mypage/chat/*
Disallow /mypage/chat/*/*
Disallow /notification-settings/
Disallow /us/gift-card-exchange/
Disallow /favorites/
Disallow /favorites/*
Disallow /news/
Disallow /news/*
Disallow /us/personal_data/*
Disallow /jp/tos/
Disallow /jp/privacy/
Disallow /jp/tokutei/
Disallow /jp/box/

*

Rule Path
Disallow /tos/
Disallow /privacy/
Disallow /w9/
Disallow /reauthenticate/
Disallow /password/reset/*
Disallow /email_confirmation/done/
Disallow /id_verification/
Disallow /us/agreements/
Disallow /security_notifications/feedback/
Disallow /us/authorized-reseller/signup/
Disallow /consent/
Disallow /transaction/
Disallow /transaction/*
Disallow /transaction/*/*
Disallow /express-checkout/
Disallow /express-checkout/*
Disallow /sell/
Disallow /sell/*
Disallow /sell/*/*
Disallow /sell/*/*/*
Disallow /us/selling/
Disallow /us/selling/*
Disallow /u/
Disallow /u/*
Disallow /u/*/*
Disallow /mypage/
Disallow /mypage/*
Disallow /mypage/listings/*
Disallow /mypage/listings/draft/*
Disallow /mypage/sales/*
Disallow /mypage/sales/history/*
Disallow /mypage/purchase/
Disallow /mypage/purchase/*
Disallow /mypage/chat/
Disallow /mypage/chat/*
Disallow /mypage/chat/*/*
Disallow /notification-settings/
Disallow /us/gift-card-exchange/
Disallow /favorites/
Disallow /favorites/*
Disallow /news/
Disallow /news/*
Disallow /us/personal_data/*
Disallow /jp/tos/
Disallow /jp/privacy/
Disallow /jp/tokutei/
Disallow /jp/box/

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.mercari.com/us-sitemap-index.xml