Log In Sign Up

cliksdz.com
robots.txt

Robots Exclusion Standard data for cliksdz.com

Resource Scan

Scan Details

Site Domain cliksdz.com
Base Domain cliksdz.com
Scan Status Ok
Last Scan2026-01-01T21:08:54+00:00
Next Scan 2026-01-15T21:08:54+00:00

Last Scan

Scanned2026-01-01T21:08:54+00:00
URL https://www.cliksdz.com/robots.txt
Domain IPs 104.26.14.130, 104.26.15.130, 172.67.71.118, 2606:4700:20::681a:e82, 2606:4700:20::681a:f82, 2606:4700:20::ac43:4776
Response IP 104.26.15.130
Found Yes
Hash dfd59162225481040c41d8cd1fb4481181269975216923f19243effd31c89448
SimHash 4018ca00e5b5

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

*

Rule Path
Allow /
Back to top

Comments

  • Allow major search engines
  • Block AI training bots
  • Allow all other crawlers
  • Sitemap location
  • Sitemap: https://justsell.store/sitemap.xml
Back to top