coffeemart.vn
robots.txt

Robots Exclusion Standard data for coffeemart.vn

Resource Scan

Scan Details

Site Domain coffeemart.vn
Base Domain coffeemart.vn
Scan Status Ok
Last Scan2025-04-06T08:00:57+00:00
Next Scan 2025-05-06T08:00:57+00:00

Last Scan

Scanned2025-04-06T08:00:57+00:00
URL https://coffeemart.vn/robots.txt
Redirect https://www.coffeemart.vn/robots.txt
Redirect Domain www.coffeemart.vn
Redirect Base coffeemart.vn
Domain IPs 118.69.80.35
Redirect IPs 118.69.80.35
Response IP 118.69.80.35
Found Yes
Hash ba1bf4b4feab4bf21346e69bec41e971939a43124291e74b4d5722ace084f5db
SimHash a715de4adec0

Groups

*

Rule Path
Disallow /admin
Disallow /cart
Disallow /carts
Disallow /orders
Disallow /checkout
Disallow /checkouts
Disallow /account
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /search
Disallow /discount/*
Disallow /apple-app-site-association

adsbot-google

Rule Path
Disallow /checkout
Disallow /checkouts
Disallow /carts
Disallow /orders
Disallow /discount/*

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /admin
Disallow /cart
Disallow /carts
Disallow /orders
Disallow /checkout
Disallow /checkouts
Disallow /account
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /search
Disallow /discount/*
Disallow /apple-app-site-association

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /admin
Disallow /cart
Disallow /carts
Disallow /orders
Disallow /checkout
Disallow /checkouts
Disallow /account
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /search
Disallow /discount/*
Disallow /apple-app-site-association

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.coffeemart.vn/sitemap.xml
sitemap https://www.coffeemart.vn/sitemap.xml
sitemap https://www.coffeemart.vn/sitemap.xml

Comments

  • we use Haravan as our ecommerce platform
  • Google adsbot ignores robots.txt unless specifically named!