baofuforever.com
robots.txt

Robots Exclusion Standard data for baofuforever.com

Resource Scan

Scan Details

Site Domain baofuforever.com
Base Domain baofuforever.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-09T07:12:36+00:00
Next Scan 2026-01-07T07:12:36+00:00

Last Successful Scan

Scanned2022-12-01T19:11:18+00:00
URL https://baofuforever.com/robots.txt
Redirect https://www.baofuforever.com/robots.txt
Redirect Domain www.baofuforever.com
Redirect Base baofuforever.com
Domain IPs 104.17.232.29
Redirect IPs 104.17.232.29, 104.17.233.29
Response IP 104.17.233.29
Found Yes
Hash 98fbef9484797f30d7db1879c410d6940f56fc4ebaa79d066becb60fd67a4b9d
SimHash 6d159a625580

Groups

*

Rule Path
Disallow /adspy
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkout
Disallow /trade
Disallow /account
Disallow /user
Disallow /search
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

adsbot-google

Rule Path
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkout
Disallow /trade
Disallow /account
Disallow /user
Disallow /search
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkout
Disallow /trade
Disallow /account
Disallow /user
Disallow /search
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkout
Disallow /trade
Disallow /account
Disallow /user
Disallow /search
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.baofuforever.com/sitemap.xml

Comments

  • Google adsbot ignores robots.txt unless specifically named!