Log In Sign Up

globaltechcouncil.org
robots.txt

Robots Exclusion Standard data for globaltechcouncil.org

Resource Scan

Scan Details

Site Domain globaltechcouncil.org
Base Domain globaltechcouncil.org
Scan Status Ok
Last Scan2025-11-29T00:48:47+00:00
Next Scan 2025-12-06T00:48:47+00:00

Last Scan

Scanned2025-11-29T00:48:47+00:00
URL https://globaltechcouncil.org/robots.txt
Redirect https://www.globaltechcouncil.org/robots.txt
Redirect Domain www.globaltechcouncil.org
Redirect Base globaltechcouncil.org
Domain IPs 104.21.40.88, 172.67.183.68, 2606:4700:3032::ac43:b744, 2606:4700:3037::6815:2858
Redirect IPs 104.21.40.88, 172.67.183.68, 2606:4700:3032::ac43:b744, 2606:4700:3037::6815:2858
Response IP 172.67.183.68
Found Yes
Hash d7a8274fe1f80b9feff73a45f1f7ec180cf72476d87e55cdce71e0e180dca035
SimHash 6ba01a50e3b3

Groups

*

Rule Path
Disallow /wp-includes/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/

Other Records

Field Value
crawl-delay 5

scrapy

Rule Path
Allow /

adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps

Rule Path
Allow /

linkedinbot

Rule Path
Allow /account/accomplishments/

twitterbot

Rule Path
Allow /account/accomplishments/
Disallow /wp-includes/
Disallow /wp-admin/
Disallow /tag/

chatgpt-user

Rule Path
Allow /

gptbot

Rule Path
Allow /

google-extended

Rule Path
Allow /

claudebot

Rule Path
Allow /

ccbot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.globaltechcouncil.org/sitemap_index.xml
Back to top

Comments

  • =====================================
  • Robots.txt | Global Tech Council
  • Mode: Full Visibility (SEO + AI/LLM Allowed)
  • Updated: Oct 2025
  • =====================================
  • =====================================
  • AI Bots Allowed
  • =====================================
  • =====================================
  • Sitemap
  • =====================================
Back to top