Log In Sign Up

telugutimes.net
robots.txt

Robots Exclusion Standard data for telugutimes.net

Resource Scan

Scan Details

Site Domain telugutimes.net
Base Domain telugutimes.net
Scan Status Ok
Last Scan2026-03-26T11:46:46+00:00
Next Scan 2026-04-02T11:46:46+00:00

Last Scan

Scanned2026-03-26T11:46:46+00:00
URL https://telugutimes.net/robots.txt
Redirect https://www.telugutimes.net/robots.txt
Redirect Domain www.telugutimes.net
Redirect Base telugutimes.net
Domain IPs 104.21.4.150, 172.67.154.50, 2606:4700:3034::6815:496, 2606:4700:3037::ac43:9a32
Redirect IPs 104.21.4.150, 172.67.154.50, 2606:4700:3034::6815:496, 2606:4700:3037::ac43:9a32
Response IP 172.67.154.50
Found Yes
Hash 1ce12b67b580ea68f117595a81ca8c11c4c0e674a2321f212124f0e72596d4ba
SimHash 41165da04613

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

facebot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

whatsapp

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

applebot

Rule Path
Allow /

uptimerobot

Rule Path
Allow /

yandexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seekport

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

seodiver

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

lipperhey

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

proximic

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

panscient

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

openindexspider

Rule Path
Disallow /

addthis

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

curl

Rule Path
Disallow /

wget

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

java

Rule Path
Disallow /

libwww-perl

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

urllib

Rule Path
Disallow /

nutch

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /xmlrpc.php
Disallow /comments/feed/
Disallow /?s=
Disallow /search/
Disallow /tag/
Disallow /author/
Disallow /trackback/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /admin/
Disallow /login/
Disallow /register/
Disallow /*.php$
Disallow /*.json$
Disallow /cart/
Disallow /checkout/
Back to top

Other Records

Field Value
sitemap https://www.telugutimes.net/sitemap.xml
sitemap https://www.telugutimes.net/sitemap_index.xml
sitemap https://www.telugutimes.net/news-sitemap.xml
Back to top

Comments

  • -----------------------------------------------
  • ALLOW: Legitimate Search Engine Crawlers
  • -----------------------------------------------
  • -----------------------------------------------
  • BLOCK: Known Bad Bots & Scrapers
  • -----------------------------------------------
  • -----------------------------------------------
  • BLOCK: Sensitive/Internal Paths from ALL bots
  • -----------------------------------------------
  • -----------------------------------------------
  • Sitemap
  • -----------------------------------------------
Back to top