vn.mlb-korea.com
robots.txt

Robots Exclusion Standard data for vn.mlb-korea.com

Resource Scan

Scan Details

Site Domain vn.mlb-korea.com
Base Domain mlb-korea.com
Scan Status Ok
Last Scan2026-01-28T18:16:51+00:00
Next Scan 2026-02-27T18:16:51+00:00

Last Scan

Scanned2026-01-28T18:16:51+00:00
URL https://vn.mlb-korea.com/robots.txt
Domain IPs 103.154.102.24
Response IP 103.154.102.24
Found Yes
Hash 3a928593ee9dcacb2cf8564b456b57f58ff951a84aa94f08d27dfc6c2b4a5973
SimHash af15de4a5ed0

Groups

*

Rule Path
Disallow /admin
Disallow /cart
Disallow /carts
Disallow /orders
Disallow /checkout
Disallow /checkouts
Disallow /account
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /search
Disallow /discount/*
Disallow /apple-app-site-association
Disallow /*?view
Disallow /*?filter
Disallow /*?color
Disallow /*?refresh
Disallow /tagged/*
Disallow /*?variant

adsbot-google

Rule Path
Disallow /checkout
Disallow /checkouts
Disallow /carts
Disallow /orders
Disallow /discount/*
Disallow /*?view
Disallow /*?filter
Disallow /*?color
Disallow /*?refresh
Disallow /tagged/*
Disallow /*?variant

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /admin
Disallow /cart
Disallow /carts
Disallow /orders
Disallow /checkout
Disallow /checkouts
Disallow /account
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /search
Disallow /discount/*
Disallow /apple-app-site-association
Disallow /*?view
Disallow /*?filter
Disallow /*?color
Disallow /*?refresh
Disallow /tagged/*
Disallow /*?variant

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /admin
Disallow /cart
Disallow /carts
Disallow /orders
Disallow /checkout
Disallow /checkouts
Disallow /account
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /search
Disallow /discount/*
Disallow /apple-app-site-association
Disallow /*?view
Disallow /*?filter
Disallow /*?color
Disallow /*?refresh
Disallow /tagged/*
Disallow /*?variant

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://vn.mlb-korea.com/sitemap.xml
sitemap https://vn.mlb-korea.com/sitemap.xml
sitemap https://vn.mlb-korea.com/sitemap.xml

Comments

  • we use Haravan as our ecommerce platform
  • Google adsbot ignores robots.txt unless specifically named!