Log In Sign Up

auth-ibm.seismic.com
robots.txt

Robots Exclusion Standard data for auth-ibm.seismic.com

Resource Scan

Scan Details

Site Domain auth-ibm.seismic.com
Base Domain seismic.com
Scan Status Ok
Last Scan2024-09-19T15:35:13+00:00
Next Scan 2024-10-19T15:35:13+00:00

Last Scan

Scanned2024-09-19T15:35:13+00:00
URL https://auth-ibm.seismic.com/robots.txt
Domain IPs 104.18.6.124, 104.18.7.124, 2606:4700::6812:67c, 2606:4700::6812:77c
Response IP 104.18.6.124
Found Yes
Hash 4b501b772f0989ef9117a4eff158f72674c98e10b03b48fc1405c64eb4fbfdd7
SimHash 4d17db42f3d1

Groups

*

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow /

adsbot-google-mobile

Rule Path
Disallow /

adsbot-google-mobile-apps

Rule Path
Disallow /
Back to top

Comments

  • Group 1 : Block all but AdsBot crawlers (except the various AdsBot crawlers, which must be named explicitly)
  • Group 2: Block AdsBot crawlers
  • Group 3: Block AdsBot crawlers
  • Group 4: Block AdsBot crawlers
Back to top