giaydepthuanh11.myharavan.com
robots.txt

Robots Exclusion Standard data for giaydepthuanh11.myharavan.com

Resource Scan

Scan Details

Site Domain giaydepthuanh11.myharavan.com
Base Domain myharavan.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-04-12T18:34:31+00:00
Next Scan 2025-05-12T18:34:31+00:00

Last Successful Scan

Scanned2025-02-19T18:33:39+00:00
URL https://giaydepthuanh11.myharavan.com/robots.txt
Redirect https://giaydepthuanh.com/robots.txt
Redirect Domain giaydepthuanh.com
Redirect Base giaydepthuanh.com
Domain IPs 118.69.80.16
Redirect IPs 118.69.80.16
Response IP 118.69.80.16
Found Yes
Hash b44255b5c4157eb2df4d4d81483cb472a5dce0dc4df02e689c611c369e9314c1
SimHash a715de4ad4c0

Groups

*

Rule Path
Disallow /admin
Disallow /cart
Disallow /carts
Disallow /orders
Disallow /checkout
Disallow /checkouts
Disallow /account
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /search
Disallow /discount/*
Disallow /apple-app-site-association

adsbot-google

Rule Path
Disallow /checkout
Disallow /checkouts
Disallow /carts
Disallow /orders
Disallow /discount/*

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /admin
Disallow /cart
Disallow /carts
Disallow /orders
Disallow /checkout
Disallow /checkouts
Disallow /account
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /search
Disallow /discount/*
Disallow /apple-app-site-association

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /admin
Disallow /cart
Disallow /carts
Disallow /orders
Disallow /checkout
Disallow /checkouts
Disallow /account
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /search
Disallow /discount/*
Disallow /apple-app-site-association

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://giaydepthuanh.com/sitemap.xml
sitemap https://giaydepthuanh.com/sitemap.xml
sitemap https://giaydepthuanh.com/sitemap.xml

Comments

  • we use Haravan as our ecommerce platform
  • Google adsbot ignores robots.txt unless specifically named!