Log In Sign Up

telugubharath.com
robots.txt

Robots Exclusion Standard data for telugubharath.com

Resource Scan

Scan Details

Site Domain telugubharath.com
Base Domain telugubharath.com
Scan Status Ok
Last Scan2025-10-29T13:38:46+00:00
Next Scan 2025-11-05T13:38:46+00:00

Last Scan

Scanned2025-10-29T13:38:46+00:00
URL https://telugubharath.com/robots.txt
Redirect https://www.telugubharath.com/robots.txt
Redirect Domain www.telugubharath.com
Redirect Base telugubharath.com
Domain IPs 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Redirect IPs 172.253.118.121, 2404:6800:4003:c03::79
Response IP 74.125.130.121
Found Yes
Hash ba188c9bbdd17fdd44325eb8dc6d6c912e03c079835006c2349923457156ce42
SimHash 515ff08ac6a2

Groups

mediapartners-google

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

msnbot

Rule Path
Allow /

slurp

Rule Path
Allow /

teoma

Rule Path
Allow /

gigabot

Rule Path
Allow /

robozilla

Rule Path
Allow /

nutch

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

baiduspider

Rule Path
Allow /

naverbot

Rule Path
Allow /

yeti

Rule Path
Allow /

yahoo-mmcrawler

Rule Path
Allow /

psbot

Rule Path
Allow /

yahoo-blogs/v3.9

Rule Path
Allow /

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

baiduspider

Rule Path
Disallow

baiduspider-image

Rule Path
Disallow

baiduspider-mobile

Rule Path
Disallow

baiduspider-video

Rule Path
Disallow

bingbot

Rule Path
Disallow

msnbot

Rule Path
Disallow

msnbot-media

Rule Path
Disallow

adidxbot

Rule Path
Disallow

googlebot

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

googlebot-news

Rule Path
Disallow

googlebot-video

Rule Path
Disallow

storebot-google

Rule Path
Disallow

slurp

Rule Path
Disallow

yandex

Rule Path
Disallow

_zbot

Rule Path
Disallow

adsbot-google-mobile

Rule Path
Disallow

adbeat_bot

Rule Path
Disallow

adminlabs

Rule Path
Disallow

advanced_crawler

Rule Path
Disallow

adventurer

Rule Path
Disallow

agakidsbot

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow

ahrefssiteaudit

Rule Path
Disallow

ai2bot

Rule Path
Disallow

aihitbot

Rule Path
Disallow

alexabot

Rule Path
Disallow

alexandriaorgbot

Rule Path
Disallow

alienfarm

Rule Path
Disallow

alittle_client

Rule Path
Disallow

allorigins

Rule Path
Disallow

alyzebot

Rule Path
Disallow

amazonbot

Rule Path
Disallow

anderspinkbot

Rule Path
Disallow

antbot

Rule Path
Disallow

anthropic-bot

Rule Path
Disallow

applebot

Rule Path
Disallow

applebot-extended

Rule Path
Disallow

aragog

Rule Path
Disallow

aranea

Rule Path
Disallow

archive.org_bot

Rule Path
Disallow

archivebot

Rule Path
Disallow

archiveteam

Rule Path
Disallow

arquivo-web-crawler

Rule Path
Disallow

asanacrawler

Rule Path
Disallow

ustc-autoconfig

Rule Path
Disallow

awariobot

Rule Path
Disallow

awariosmartbot

Rule Path
Disallow

awinbot

Rule Path
Disallow

bad-neighborhood

Rule Path
Disallow

baiduspider

Rule Path
Disallow

barkrowler

Rule Path
Disallow

bazqux

Rule Path
Disallow

bdbot

Rule Path
Disallow

beeperbot

Rule Path
Disallow

bingbot

Rule Path
Disallow

bingpreview

Rule Path
Disallow

birdcrawlerbot

Rule Path
Disallow

bitlybot

Rule Path
Disallow

bitsightbot

Rule Path
Disallow

bitsightbot

Rule Path
Disallow

bl.uk_bot

Rule Path
Disallow

blackboard

Rule Path
Disallow

blexbot

Rule Path
Disallow

blogtrottr

Rule Path
Disallow

botify

Rule Path
Disallow

botpoke

Rule Path
Disallow

brandprotectbot

Rule Path
Disallow

brandverity

Rule Path
Disallow

brightedge

Rule Path
Disallow

brokenlinkcheck

Rule Path
Disallow

bublupbot

Rule Path
Disallow

builtwithcrawler

Rule Path
Disallow

butterfly

Rule Path
Disallow

bytedancespider

Rule Path
Disallow

bytespider

Rule Path
Disallow

castfeedvalidator

Rule Path
Disallow

ccbot

Rule Path
Disallow

censysinspect

Rule Path
Disallow

centurybot9

Rule Path
Disallow

cert-pl-crawler

Rule Path
Disallow

certytags

Rule Path
Disallow

charlotte

Rule Path
Disallow

chatglm-spider

Rule Path
Disallow

chatgpt-user

Rule Path
Disallow

chatworkcrawler

Rule Path
Disallow

check-host

Rule Path
Disallow

checkmarknetwork

Rule Path
Disallow

chirp-bot

Rule Path
Disallow

chrome-privacy-preserving-prefetch-proxy

Rule Path
Disallow

chrome-lighthouse

Rule Path
Disallow

cincraw

Rule Path
Disallow

cirrusexplorer

Rule Path
Disallow

clarin

Rule Path
Disallow

claude-web.

Rule Path
Disallow

claudebot

Rule Path
Disallow

clickagy

Rule Path
Disallow

cloudflare

Rule Path
Disallow

coccocbot-web

Rule Path
Disallow

cocolyze

Rule Path
Disallow

cohere-ai

Rule Path
Disallow

cohere-training-data-crawler

Rule Path
Disallow

commafeed

Rule Path
Disallow

comsys-crawler

Rule Path
Disallow

contentking

Rule Path
Disallow

contentking

Rule Path
Disallow

cookiebot

Rule Path
Disallow

crawler

Rule Path
Disallow

crissyfieldbot

Rule Path
Disallow

criticalpathcssbot

Rule Path
Disallow

cron-job.org

Rule Path
Disallow

cronless

Rule Path
Disallow

crusty

Rule Path
Disallow

csirt-cz

Rule Path
Disallow

cxk_bot

Rule Path
Disallow

darkvisitorclient

Rule Path
Disallow

darkvisitor-server

Rule Path
Disallow

deepcrawl

Rule Path
Disallow

deepseekbot

Rule Path
Disallow

deskyobot

Rule Path
Disallow

diffbot

Rule Path
Disallow

dingtalkbot

Rule Path
Disallow

discourse

Rule Path
Disallow

dmbot

Rule Path
Disallow

domainsprojectbot

Rule Path
Disallow

domainsbot

Rule Path
Disallow

domainstatsbot

Rule Path
Disallow

dotbot

Rule Path
Disallow

duckassistbot

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

duckduckbot-favicons

Rule Path
Disallow

easybib

Rule Path
Disallow

edgecrawler

Rule Path
Disallow

edgewatch

Rule Path
Disallow

elastic

Rule Path
Disallow

elementor

Rule Path
Disallow

ev-crawler

Rule Path
Disallow

exabot

Rule Path
Disallow

facebookbot

Rule Path
Disallow

facebookexternalhit

Rule Path
Disallow

fast-webcrawler

Rule Path
Disallow

google-favicon

Rule Path
Disallow

duckduckgo-favicons-bot

Rule Path
Disallow

fccn

Rule Path
Disallow

foregenix

Rule Path
Disallow

goodzer

Rule Path
Disallow

github-camo

Rule Path
Disallow

globalwebsearch

Rule Path
Disallow

googlecloudmonitoring

Rule Path
Disallow

google-read-aloud

Rule Path
Disallow

storebot

Rule Path
Disallow

google web preview

Rule Path
Disallow

google-area120

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

google-extended

Rule Path
Disallow

google-inspectiontool

Rule Path
Disallow

google-read-aloud

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googleassociationservice

Rule Path
Disallow

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

googledocs

Rule Path
Disallow

gotsitemonitor

Rule Path
Disallow

gptbot

Rule Path
Disallow

grammarly

Rule Path
Disallow

gtmetrix

Rule Path
Disallow

hypefactors

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

ia_archiver-web.archive.org

Rule Path
Disallow

iaskspider

Rule Path
Disallow

ibmcrawler

Rule Path
Disallow

iframely

Rule Path
Disallow

*

Rule Path
Allow /
Allow /m%3D1
Allow /?m=1
Allow /label/?posts=
Allow /posts
Back to top

Other Records

Field Value
sitemap https://www.telugubharath.com/sitemap.xml
sitemap https://www.telugubharath.com/atom.xml?redirect=false&start-index=1&max-results=500
sitemap https://www.telugubharath.com/sitemap.xml
sitemap https://telugubharath.com/sitemap.xml
sitemap https://www.telugubharath.com/sitemap-pages.xml
sitemap https://telugubharatha.blogspot.com/feeds/posts/default?orderby=UPDATED
sitemap https://www.telugubharath.com/feeds/posts/default?orderby=UPDATED
sitemap https://telugubharath.com/feeds/posts/default?orderby=UPDATED
sitemap https://telugubharatha.blogspot.com/sitemap.xml
sitemap https://www.telugubharatha.blogspot.com/sitemap.xml
sitemap https://telugubharatha.blogspot.com/sitemap-pages.xml
sitemap https://www.telugubharatha.blogspot.com/sitemap-pages.xml
sitemap https://freehinduismebooks.blogspot.com/feeds/posts/default?orderby=UPDATED
sitemap https://www.telugubharatha.blogspot.com/feeds/posts/default?orderby=UPDATED
sitemap https://telugubharath.com/feeds/posts/default?orderby=UPDATED
Back to top

Warnings

  • 6 invalid lines.
Back to top