biiurec.com
robots.txt

Robots Exclusion Standard data for biiurec.com

Resource Scan

Scan Details

Site Domain biiurec.com
Base Domain biiurec.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-12-05T14:18:01+00:00
Next Scan 2026-03-05T14:18:01+00:00

Last Successful Scan

Scanned2022-10-11T11:22:31+00:00
URL https://biiurec.com/robots.txt
Redirect https://www.biiurec.com/robots.txt
Redirect Domain www.biiurec.com
Redirect Base biiurec.com
Response IP 104.17.233.29, 104.17.232.29
Found Yes
Hash 82006fb3722ef56f6605515c6428af01ef5aeacc5f51603af7be8e9a9b2d2129
SimHash 6d15da625501

Groups

*

Rule Path
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkout
Disallow /trade
Disallow /account
Disallow /user
Disallow /search
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

adsbot-google

Rule Path
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkout
Disallow /trade
Disallow /account
Disallow /user
Disallow /search
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkout
Disallow /trade
Disallow /account
Disallow /user
Disallow /search
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkout
Disallow /trade
Disallow /account
Disallow /user
Disallow /search
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.biiurec.com/sitemap.xml

Comments

  • Google adsbot ignores robots.txt unless specifically named!