ystdn.com
robots.txt

Robots Exclusion Standard data for ystdn.com

Resource Scan

Scan Details

Site Domain ystdn.com
Base Domain ystdn.com
Scan Status Ok
Last Scan2025-10-04T16:08:25+00:00
Next Scan 2025-11-03T16:08:25+00:00

Last Scan

Scanned2025-10-04T16:08:25+00:00
URL https://ystdn.com/robots.txt
Redirect https://zonrrandy.online/robots.txt
Redirect Domain zonrrandy.online
Redirect Base zonrrandy.online
Domain IPs 104.17.232.29
Redirect IPs 104.17.232.29
Response IP 104.17.232.29
Found Yes
Hash 5b6217e476f1ae150fcfeeac7836bb4c691e0423ec919d9fa0f28be1def4d6d5
SimHash e9158e535f00

Groups

*

Rule Path
Disallow /admin
Disallow /*/checkouts/*
Disallow /cart
Disallow /*/orders/*
Disallow /orders/*
Disallow /trade/*
Disallow /checkout/*
Disallow /invoices
Disallow /payment_methods
Disallow /search
Disallow /products/search
Disallow /user
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

adsbot-google

Rule Path
Disallow /admin
Disallow /*/checkouts/*
Disallow /cart
Disallow /*/orders/*
Disallow /orders/*
Disallow /trade/*
Disallow /checkout/*
Disallow /invoices
Disallow /payment_methods
Disallow /search
Disallow /products/search
Disallow /user
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /admin
Disallow /*/checkouts/*
Disallow /cart
Disallow /*/orders/*
Disallow /orders/*
Disallow /trade/*
Disallow /checkout/*
Disallow /invoices
Disallow /payment_methods
Disallow /search
Disallow /products/search
Disallow /user
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /admin
Disallow /*/checkouts/*
Disallow /cart
Disallow /*/orders/*
Disallow /orders/*
Disallow /trade/*
Disallow /checkout/*
Disallow /invoices
Disallow /payment_methods
Disallow /search
Disallow /products/search
Disallow /user
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

adsbot-google

Product Comment
adsbot-google 专门用于广告审核和评估的爬虫
Rule Path Comment
Allow / 允许抓取整个网站(推荐,或指定具体着陆页目录)
Allow /landing-pages/ 或者更精确地指定着陆页目录
Allow /products/ 允许抓取产品目录
Allow /services/ 允许抓取服务目录

googlebot

Product Comment
googlebot 搜索引擎爬虫
Rule Path Comment
Disallow / 禁止抓取整个网站(或根据需要部分禁止)

Other Records

Field Value
sitemap https://zonrrandy.online/sitemap.xml
sitemap https://zonrrandy.online/sitemap.xml
sitemap https://zonrrandy.online/sitemap.xml
sitemap https://zonrrandy.online/sitemap.xml

Comments

  • we use Shopline as our ecommerce platform