bharat.republicworld.com
robots.txt

Robots Exclusion Standard data for bharat.republicworld.com

Resource Scan

Scan Details

Site Domain bharat.republicworld.com
Base Domain republicworld.com
Scan Status Ok
Last Scan2026-04-01T00:50:37+00:00
Next Scan 2026-04-08T00:50:37+00:00

Last Scan

Scanned2026-04-01T00:50:37+00:00
URL http://bharat.republicworld.com/robots.txt
Redirect https://www.republicbharat.com/robots.txt
Redirect Domain www.republicbharat.com
Redirect Base republicbharat.com
Domain IPs 34.128.144.153
Redirect IPs 13.35.37.3, 13.35.37.37, 13.35.37.45, 13.35.37.72, 2600:9000:213e:1c00:1a:cede:9200:93a1, 2600:9000:213e:4000:1a:cede:9200:93a1, 2600:9000:213e:5400:1a:cede:9200:93a1, 2600:9000:213e:5800:1a:cede:9200:93a1, 2600:9000:213e:7c00:1a:cede:9200:93a1, 2600:9000:213e:cc00:1a:cede:9200:93a1, 2600:9000:213e:f000:1a:cede:9200:93a1, 2600:9000:213e:f200:1a:cede:9200:93a1
Response IP 13.35.37.37
Found Yes
Hash 94809c4335055d868d1d09000fad75f28a1db6f3da4a1b058a84962d2ff2edaa
SimHash 79185870e113

Groups

*

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

ccbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

claudebot

Rule Path
Allow /

claude-web

Rule Path
Allow /

google-extended

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

facebookbot

Rule Path
Allow /

applebot

Rule Path
Allow /

youbot

Rule Path
Allow /
Disallow *?*
Disallow */sports-news/*
Disallow */technology-news/*
Disallow */sports-news/*
Disallow *.html*
Disallow */entertainment/entertainment/*
Disallow */entertainment/television/entertainment/television/*
Disallow */sports/cricket/sports/cricket/*
Disallow */tech/tech/tech/*
Disallow */business/business/business/*
Disallow */lifestyle/lifestyle/*
Disallow */economy/economy/*
Disallow */india/india/india/india/*
Disallow */_app/*
Disallow */tags/*
Disallow /amp/web-stories/
Disallow /amp/web-stories/*
Disallow /amp/shorts/
Disallow /amp/shorts/*
Disallow /amp/taboola-app/
Disallow /amp/taboola-app
Disallow /amp/taboola-app/*
Disallow /policies-disclaimers-app/
Disallow /policies-disclaimers-app/*
Disallow /privacy-policy-app/
Disallow /mgid/
Disallow /mgid/*
Disallow /amp/mgid-app/
Disallow /amp/mgid-app/*
Disallow *.news*
Disallow *?jw_start=*
Disallow *utm_*
Disallow /*/*/$
Disallow /*/$
Disallow /world-news/world-news/
Disallow /amp/amp/
Disallow /anchors-and-authors/
Disallow */assets/*
Disallow */assets/

Other Records

Field Value
sitemap https://www.republicbharat.com/sitemap/sitemap-news.xml
sitemap https://www.republicbharat.com/sitemap/index-sitemap.xml