Log In Sign Up

telenangai.com
robots.txt

Robots Exclusion Standard data for telenangai.com

Resource Scan

Scan Details

Site Domain telenangai.com
Base Domain telenangai.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-12T11:53:21+00:00
Next Scan 2026-04-13T11:53:21+00:00

Last Successful Scan

Scanned2025-11-22T09:01:49+00:00
URL https://telenangai.com/robots.txt
Domain IPs 104.21.15.116, 172.67.162.147, 2606:4700:3030::ac43:a293, 2606:4700:3031::6815:f74
Response IP 172.67.162.147
Found Yes
Hash 3f88f190861b7001ef93245fee25bb0e1bf5bc314e9dea668b71865460b38ca7
SimHash 401ddcb0e593

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

yandexbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap http://telenangai.com/api/sitemap-index
Back to top

Comments

  • Allow major search engines
  • Block AI scrapers
  • Block bad bots
Back to top