chainit.com
robots.txt

Robots Exclusion Standard data for chainit.com

Resource Scan

Scan Details

Site Domain chainit.com
Base Domain chainit.com
Scan Status Ok
Last Scan2025-12-22T22:57:45+00:00
Next Scan 2026-01-21T22:57:45+00:00

Last Scan

Scanned2025-12-22T22:57:45+00:00
URL https://chainit.com/robots.txt
Domain IPs 160.153.0.96
Response IP 160.153.0.96
Found Yes
Hash e3180f2f49730505d5f4071d554b6dc87b506eb27139b3ca59a3931d59693797
SimHash 7b844841e0a3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /readme.html
Disallow /license.txt
Allow /wp-admin/admin-ajax.php

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

gptbot

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

facebookbot

Rule Path
Allow /

meta-externalagent

Rule Path
Allow /

youbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

omgilibot

Rule Path
Allow /

omgili

Rule Path
Allow /

applebot-extended

Rule Path
Allow /

duckassistbot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

claudebot

Rule Path
Allow /

google-extended

Rule Path
Allow /

ccbot

Rule Path
Allow /

amazonbot

Rule Path
Allow /

cohere-ai

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

gemini

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.chainit.com/sitemap_index.xml

Comments

  • --- AI/LLM CRAWLER ---
  • Sitemap