m.tribuneindia.com
robots.txt

Robots Exclusion Standard data for m.tribuneindia.com

Resource Scan

Scan Details

Site Domain m.tribuneindia.com
Base Domain tribuneindia.com
Scan Status Ok
Last Scan2024-05-11T08:07:52+00:00
Next Scan 2024-06-10T08:07:52+00:00

Last Scan

Scanned2024-05-11T08:07:52+00:00
URL https://m.tribuneindia.com/robots.txt
Domain IPs 104.22.50.224, 104.22.51.224, 172.67.9.111, 2606:4700:10::6816:32e0, 2606:4700:10::6816:33e0, 2606:4700:10::ac43:96f
Response IP 172.67.9.111
Found Yes
Hash eeffd6bfd1903e35a152b35c30df4b8659f6c40ae9168ef6aa7831f73faa2ef7
SimHash 4904c0504512

Groups

*

Rule Path
Allow /
Disallow /news/preview*
Disallow /19*
Disallow /20*
Disallow /Pagination/*
Disallow /multimedia/*

mediapartners-google

Rule Path
Allow /
Disallow /news/preview*
Disallow /19*
Disallow /20*
Disallow /Pagination/*
Disallow /multimedia/*

googlebot

Rule Path
Allow /
Disallow /news/preview*
Disallow /19*
Disallow /20*
Disallow /Pagination/*
Disallow /multimedia/*

googlebot-news

Rule Path
Allow /
Disallow /news/preview*
Disallow /19*
Disallow /20*
Disallow /Pagination/*
Disallow /multimedia/*

bingbot

Rule Path
Allow /
Disallow /news/preview*
Disallow /19*
Disallow /20*
Disallow /Pagination/*
Disallow /multimedia/*

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.tribuneindia.com/sitemap.xml
sitemap https://www.tribuneindia.com/newssitemap.xml