Log In Sign Up

bitbox.shop
robots.txt

Robots Exclusion Standard data for bitbox.shop

Resource Scan

Scan Details

Site Domain bitbox.shop
Base Domain bitbox.shop
Scan Status Ok
Last Scan2025-08-11T06:10:29+00:00
Next Scan 2025-09-10T06:10:29+00:00

Last Scan

Scanned2025-08-11T06:10:29+00:00
URL https://bitbox.shop/robots.txt
Redirect https://shop.bitbox.swiss/robots.txt
Redirect Domain shop.bitbox.swiss
Redirect Base bitbox.swiss
Domain IPs 104.21.83.61, 172.67.214.245, 2606:4700:3031::6815:533d, 2606:4700:3035::ac43:d6f5
Redirect IPs 104.26.0.40, 104.26.1.40, 172.67.68.208, 2606:4700:20::681a:128, 2606:4700:20::681a:28, 2606:4700:20::ac43:44d0
Response IP 104.26.0.40
Found Yes
Hash 256bb9463e2e43ee6314cca3e9fbf2fdcc6c9def9ed45b6351f47fc351327cfa
SimHash 05c0bfc3c81d

Groups

*

Rule Path
Disallow /*/account/
Disallow /dashboard/
Disallow /checkout/
Disallow /en/checkout/
Disallow /de/checkout/
Disallow /es/checkout/
Disallow /it/checkout/

adsbot-google

Rule Path
Disallow /*/account/
Disallow /dashboard/
Disallow /checkout/
Disallow /en/checkout/
Disallow /de/checkout/
Disallow /es/checkout/
Disallow /it/checkout/

adsbot-google-mobile

Rule Path
Disallow /*/account/
Disallow /dashboard/
Disallow /checkout/
Disallow /en/checkout/
Disallow /de/checkout/
Disallow /es/checkout/
Disallow /it/checkout/

adsbot-google-mobile-apps

Rule Path
Disallow /*/account/
Disallow /dashboard/
Disallow /checkout/
Disallow /en/checkout/
Disallow /de/checkout/
Disallow /es/checkout/
Disallow /it/checkout/

mediapartners-google

Rule Path
Disallow /*/account/
Disallow /dashboard/
Disallow /checkout/
Disallow /en/checkout/
Disallow /de/checkout/
Disallow /es/checkout/
Disallow /it/checkout/

googlebot

Rule Path
Disallow /*/account/
Disallow /dashboard/
Disallow /checkout/
Disallow /en/checkout/
Disallow /de/checkout/
Disallow /es/checkout/
Disallow /it/checkout/

googlebot-image

Rule Path
Disallow /*/account/
Disallow /dashboard/
Disallow /checkout/
Disallow /en/checkout/
Disallow /de/checkout/
Disallow /es/checkout/
Disallow /it/checkout/

storebot-google

Rule Path
Disallow /*/account/
Disallow /dashboard/
Disallow /checkout/
Disallow /en/checkout/
Disallow /de/checkout/
Disallow /es/checkout/
Disallow /it/checkout/

yandex

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap https://shop.bitbox.swiss/sitemap-products.xml
Back to top

Comments

  • This applies to all but google's ads bots, unfortunately:
  • https://developers.google.com/search/docs/advanced/robots/create-robots-txt
  • Duplicated entries from above specifically for google's ads bots.
  • https://developers.google.com/search/docs/advanced/crawling/overview-google-crawlers
  • Duplicate pages with GET parameters were found
Back to top

Warnings

  • `clean-param` is not a known field.
Back to top