ce-networks.com
robots.txt

Robots Exclusion Standard data for ce-networks.com

Resource Scan

Scan Details

Site Domain ce-networks.com
Base Domain ce-networks.com
Scan Status Ok
Last Scan2026-01-31T19:55:59+00:00
Next Scan 2026-02-07T19:55:59+00:00

Last Scan

Scanned2026-01-31T19:55:59+00:00
URL https://ce-networks.com/robots.txt
Domain IPs 3.165.102.50, 3.165.102.80, 3.165.102.81, 3.165.102.94
Response IP 3.165.102.80
Found Yes
Hash 068b444101cf868f7e7e2c28a484af73ddbbfb816904b0e8f4f27cbf25f87c95
SimHash 1210e9c7e433

Groups

*

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

ccbot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

claude-web

Rule Path
Allow /
Allow /docs
Allow /comparison
Allow /blog
Allow /pricing

Other Records

Field Value
sitemap https://cenetworks.com/sitemap.xml

Comments

  • Allow AI crawlers and training bots
  • Important pages for AI training
  • Sitemap location