cointab.com
robots.txt

Robots Exclusion Standard data for cointab.com

Resource Scan

Scan Details

Site Domain cointab.com
Base Domain cointab.com
Scan Status Ok
Last Scan2025-10-13T04:18:45+00:00
Next Scan 2025-11-12T04:18:45+00:00

Last Scan

Scanned2025-10-13T04:18:45+00:00
URL https://cointab.com/robots.txt
Domain IPs 104.21.10.80, 172.67.144.238, 2606:4700:3033::6815:a50, 2606:4700:3033::ac43:90ee
Response IP 104.21.10.80
Found Yes
Hash f72b8bf5ad649fbe510488161ce17076c40824ba35e40a9242c2725fa26efcf9
SimHash e02ae840b6a3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /search
Disallow /?s=
Disallow /page/
Disallow /feed/
Disallow /*/feed/
Disallow /trackback/
Disallow /*?replytocom
Disallow /*?share=
Disallow /*utm_*
Disallow /*?amp
Disallow /*/amp
Disallow /tag/*/page/
Disallow /category/*/page/

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://cointab.com/sitemap_index.xml

Comments

  • ==============================
  • CoinTab robots.txt
  • ==============================
  • Block common AI/data-scraper bots
  • ---------------------------
  • END YOAST BLOCK