taikulaba.com
robots.txt

Robots Exclusion Standard data for taikulaba.com

Resource Scan

Scan Details

Site Domain taikulaba.com
Base Domain taikulaba.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-18T14:50:24+00:00
Next Scan 2025-11-17T14:50:24+00:00

Last Successful Scan

Scanned2025-06-28T02:02:19+00:00
URL https://taikulaba.com/robots.txt
Domain IPs 104.17.232.29
Response IP 104.17.232.29
Found Yes
Hash 9c93539433535ccbd8fe3b83227f8a4db41ab510b49390af230e25190e7abf42
SimHash 61158c534f80

Groups

*

Rule Path
Disallow /admin
Disallow /*/checkouts/*
Disallow /cart
Disallow /*/orders/*
Disallow /orders/*
Disallow /trade/*
Disallow /checkout/*
Disallow /invoices
Disallow /payment_methods
Disallow /search
Disallow /products/search
Disallow /user
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

adsbot-google

Rule Path
Disallow /admin
Disallow /*/checkouts/*
Disallow /cart
Disallow /*/orders/*
Disallow /orders/*
Disallow /trade/*
Disallow /checkout/*
Disallow /invoices
Disallow /payment_methods
Disallow /search
Disallow /products/search
Disallow /user
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /admin
Disallow /*/checkouts/*
Disallow /cart
Disallow /*/orders/*
Disallow /orders/*
Disallow /trade/*
Disallow /checkout/*
Disallow /invoices
Disallow /payment_methods
Disallow /search
Disallow /products/search
Disallow /user
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /admin
Disallow /*/checkouts/*
Disallow /cart
Disallow /*/orders/*
Disallow /orders/*
Disallow /trade/*
Disallow /checkout/*
Disallow /invoices
Disallow /payment_methods
Disallow /search
Disallow /products/search
Disallow /user
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://taikulaba.com/sitemap.xml
sitemap https://taikulaba.com/sitemap.xml
sitemap https://taikulaba.com/sitemap.xml
sitemap https://taikulaba.com/sitemap.xml

Comments

  • we use Shopline as our ecommerce platform