timesofindia.com
robots.txt

Robots Exclusion Standard data for timesofindia.com

Resource Scan

Scan Details

Site Domain timesofindia.com
Base Domain timesofindia.com
Scan Status Ok
Last Scan2024-06-21T22:03:04+00:00
Next Scan 2024-06-28T22:03:04+00:00

Last Scan

Scanned2024-06-21T22:03:04+00:00
URL https://timesofindia.com/robots.txt
Redirect https://timesofindia.indiatimes.com/robots.txt
Redirect Domain timesofindia.indiatimes.com
Redirect Base indiatimes.com
Domain IPs 2600:1413:1::6011:b497, 2600:1413:1::6011:b4be, 96.17.180.151, 96.17.180.190
Redirect IPs 184.50.85.129, 184.50.85.137, 184.50.85.138, 184.50.85.139, 2600:1413:1::b832:5589, 2600:1413:1::b832:558a, 2600:1413:1::b832:558b, 2600:1413:1::b832:5592, 2600:1413:1::b832:5594, 96.17.180.179, 96.17.180.186, 96.17.180.187, 96.17.180.188, 96.17.180.190
Response IP 96.17.180.182
Found Yes
Hash c61a81dd6585c2682b85a6e8ddb6a3fdbfa4ea0b9853188385887def402e5bed
SimHash 6106d1266038

Groups

*

Rule Path
Allow /
Disallow /PDATOI/
Disallow /topic/quote/
Disallow /*cms.dll*
Disallow /*rssarticleshow*
Disallow /topic/photo/
Disallow /default.cms
Disallow /default1.cms
Disallow /artshowcmt/
Disallow */opinions/
Disallow /breakingnews/toihome.html
Disallow /topic/article/
Disallow /logtopickeywords*
Disallow /new_cmtofart*
Disallow /pmcomment/
Disallow /feeds/
Disallow */configspace/*
Disallow /configspace/maintenance.html
Disallow /topiclist/
Disallow */pmredirectshow/*
Disallow */stoi/*
Disallow */moviearticlelistalphabet1/*
Disallow */cinema-entertainment/*
Disallow */life-style-landing/*
Disallow *navlvl%3D
Disallow /lspoll/
Disallow *query%3D
Disallow /beta_hotlydbt/
Disallow *defalpha%3D
Disallow *%2Cpage
Disallow /new_cmtofart2_nit_v1/
Disallow *prtpage
Disallow */examshow/*
Disallow */speednewsshow/*
Disallow */speednewsbytopic/*
Disallow */itslideshow/*
Disallow */vsarticleshow/*
Disallow */articleshow_amitr/*
Disallow */pmtoinavigation/*
Disallow */mvopinions/*
Disallow */opinionslogged/*
Disallow */rodate.js
Disallow */load.js
Disallow */cookie.js
Disallow */jquery.js
Disallow */navigation.js
Disallow */pgtrack.js
Disallow */lazy.js
Disallow */breakingnews.js
Disallow */rodate.js
Disallow */mail/*
Disallow */profileshow/*
Disallow */tpoint_articleshow/*
Disallow */trivia/*
Disallow */articleshowajax/*
Disallow /articlecomment/
Disallow /artshowcmt/
Disallow /7176/TOI_Travel/
Disallow /search
Disallow /fbpostaction.cms?article=
Disallow /7176/TOI_Travel_Test/TOI_Travel_TOP_TST
Disallow /postmail.cms
Disallow /mostviewed
Disallow /related
Disallow /comments
Disallow *Jai-Mrug*
Disallow */affiliate_amazon.cms*
Disallow *-mostviwed*
Disallow */techgadgets/*
Disallow */covid-19-delhi/*
Disallow */covid-19-bangalore/*
Disallow */covid-19-hyderabad/*
Disallow */covid-19-kolkata/*
Disallow */covid-19-mumbai/*
Disallow */covid-19-across-world/*
Disallow */crshow/*
Disallow */briefs/articleid-*
Disallow /intarnel/*
Disallow */dynalist/*
Disallow */amp_msp_amazon_gadget.cms*
Disallow */affiliates_content_iframe.cms*
Disallow */affiliates_content.cms*
Disallow */affiliates_content_iframe*
Disallow */affiliates_library*
Disallow */affiliates_content*
Disallow */ifrmwdt/*
Disallow *articleshowbriefs*
Disallow *quickstirshow*
Disallow *mobile%3Dno*
Disallow *etarticleshow*
Disallow *?mobile=no*
Disallow *homeajax_nav.cms?*
Disallow *articleshowbriefs?*
Disallow *affiliates_content_iframe_v2*
Disallow *?frmapp=yes*
Disallow *embedvideo.cms*
Disallow *videodash.cms*
Disallow *etopneinappamp.cms*
Disallow *as_comments*
Disallow *RBP_HOME_URL*
Disallow *?comments*
Disallow *?showcomment*
Disallow *?cmfid*

googlebot-news

Rule Path
Allow /
Disallow /PDATOI/
Disallow /topic/quote/
Disallow /*cms.dll*
Disallow /*rssarticleshow*
Disallow /topic/photo/
Disallow /default.cms
Disallow /default1.cms
Disallow /artshowcmt/
Disallow */opinions/
Disallow /breakingnews/toihome.html
Disallow /topic/article/
Disallow /logtopickeywords*
Disallow /new_cmtofart*
Disallow /pmcomment/
Disallow /feeds/
Disallow */configspace/*
Disallow /configspace/maintenance.html
Disallow /topiclist/
Disallow */pmredirectshow/*
Disallow */stoi/*
Disallow */moviearticlelistalphabet1/*
Disallow */cinema-entertainment/*
Disallow */life-style-landing/*
Disallow *navlvl%3D
Disallow /lspoll/
Disallow *query%3D
Disallow /beta_hotlydbt/
Disallow *defalpha%3D
Disallow *%2Cpage
Disallow /new_cmtofart2_nit_v1/
Disallow *prtpage
Disallow */examshow/*
Disallow */speednewsshow/*
Disallow */speednewsbytopic/*
Disallow */itslideshow/*
Disallow */vsarticleshow/*
Disallow */articleshow_amitr/*
Disallow */pmtoinavigation/*
Disallow */mvopinions/*
Disallow */opinionslogged/*
Disallow */rodate.js
Disallow */load.js
Disallow */cookie.js
Disallow */jquery.js
Disallow */navigation.js
Disallow */pgtrack.js
Disallow */lazy.js
Disallow */breakingnews.js
Disallow */rodate.js
Disallow */mail/*
Disallow */profileshow/*
Disallow */tpoint_articleshow/*
Disallow */trivia/*
Disallow */articleshowajax/*
Disallow /articlecomment/
Disallow /artshowcmt/
Disallow /7176/TOI_Travel/
Disallow /search
Disallow /fbpostaction.cms?article=
Disallow /7176/TOI_Travel_Test/TOI_Travel_TOP_TST
Disallow /postmail.cms
Disallow /mostviewed
Disallow /related
Disallow /comments
Disallow *Jai-Mrug*
Disallow */affiliate_amazon.cms*
Disallow *-mostviwed*
Disallow */techgadgets/*
Disallow */covid-19-delhi/*
Disallow */covid-19-bangalore/*
Disallow */covid-19-hyderabad/*
Disallow */covid-19-kolkata/*
Disallow */covid-19-mumbai/*
Disallow */covid-19-across-world/*
Disallow */crshow/*
Disallow */briefs/articleid-*
Disallow /intarnel/*
Disallow */dynalist/*
Disallow */amp_msp_amazon_gadget.cms*
Disallow */affiliates_content_iframe.cms*
Disallow */affiliates_content.cms*
Disallow */affiliates_content_iframe*
Disallow */affiliates_library*
Disallow */affiliates_content*
Disallow */ifrmwdt/*
Disallow *articleshowbriefs*
Disallow *quickstirshow*
Disallow *mobile%3Dno*
Disallow *etarticleshow*
Disallow *?mobile=no*
Disallow *homeajax_nav.cms?*
Disallow *articleshowbriefs?*
Disallow *affiliates_content_iframe_v2*
Disallow *?frmapp=yes*
Disallow *embedvideo.cms*
Disallow *videodash.cms*
Disallow *etopneinappamp.cms*
Disallow *as_comments*
Disallow *RBP_HOME_URL*
Disallow *?comments*
Disallow *?showcomment*
Disallow *?cmfid*

gptbot

Rule Path
Disallow /