Log In Sign Up

shiftcrypto.ch
robots.txt

Robots Exclusion Standard data for shiftcrypto.ch

Resource Scan

Scan Details

Site Domain shiftcrypto.ch
Base Domain shiftcrypto.ch
Scan Status Ok
Last Scan2025-06-18T11:16:59+00:00
Next Scan 2025-07-18T11:16:59+00:00

Last Scan

Scanned2025-06-18T11:16:59+00:00
URL https://shiftcrypto.ch/robots.txt
Redirect https://bitbox.swiss/robots.txt
Redirect Domain bitbox.swiss
Redirect Base bitbox.swiss
Domain IPs 104.21.8.130, 172.67.157.94, 2606:4700:3030::ac43:9d5e, 2606:4700:3036::6815:882
Redirect IPs 138.199.46.68, 2400:52e0:1500::868:1
Response IP 138.199.46.65
Found Yes
Hash 16b729ed78028aa38b553e59f6dc9d9c9733612014f36166b0304ebb7f802559
SimHash 0d80bb82c93d

Groups

*

Rule Path
Disallow /blog/teaser-*

adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
mediapartners-google

Rule Path
Disallow /blog/teaser-*

yandex

No rules defined. All paths allowed.

Back to top

Comments

  • This applies to all but google's ads bots, unfortunately:
  • https://developers.google.com/search/docs/advanced/robots/create-robots-txt
  • Duplicated entries from above specifically for google's ads bots.
  • https://developers.google.com/search/docs/advanced/crawling/overview-google-crawlers
  • Duplicate pages with GET parameters were found
Back to top

Warnings

  • `clean-param` is not a known field.
Back to top