m.timesofindia.com
robots.txt

Robots Exclusion Standard data for m.timesofindia.com

Resource Scan

Scan Details

Site Domain m.timesofindia.com
Base Domain timesofindia.com
Scan Status Ok
Last Scan2024-05-08T16:43:47+00:00
Next Scan 2024-05-22T16:43:47+00:00

Last Scan

Scanned2024-05-08T16:43:47+00:00
URL https://m.timesofindia.com/robots.txt
Domain IPs 184.50.85.137, 184.50.85.147, 2600:1413:b000:1c::17d1:2ec6, 2600:1413:b000:1c::17d1:2ed9, 96.17.180.182
Response IP 184.50.85.139
Found Yes
Hash ef33242ad82be97ce244a344b3f9b533badf1b1ceea3a45b708099c96a0091be
SimHash 6304d1266410

Groups

*

Rule Path
Allow /
Disallow /PDATOI/
Disallow /topic/quote/
Disallow /*cms.dll*
Disallow /*rssarticleshow*
Disallow /topic/photo/
Disallow /default.cms
Disallow /default1.cms
Disallow /artshowcmt/
Disallow */opinions/
Disallow /breakingnews/toihome.html
Disallow /topic/article/
Disallow /logtopickeywords*
Disallow /new_cmtofart*
Disallow /pmcomment/
Disallow /feeds/
Disallow */configspace/*
Disallow /configspace/maintenance.html
Disallow /topiclist/
Disallow */pmredirectshow/*
Disallow */stoi/*
Disallow */moviearticlelistalphabet1/*
Disallow */cinema-entertainment/*
Disallow */life-style-landing/*
Disallow *navlvl%3D
Disallow /lspoll/
Disallow *query%3D
Disallow /beta_hotlydbt/
Disallow *defalpha%3D
Disallow *%2Cpage
Disallow /new_cmtofart2_nit_v1/
Disallow *prtpage
Disallow */examshow/*
Disallow */speednewsshow/*
Disallow */speednewsbytopic/*
Disallow */itslideshow/*
Disallow */vsarticleshow/*
Disallow */articleshow_amitr/*
Disallow */pmtoinavigation/*
Disallow */mvopinions/*
Disallow */opinionslogged/*
Disallow */rodate.js
Disallow */load.js
Disallow */cookie.js
Disallow */jquery.js
Disallow */navigation.js
Disallow */pgtrack.js
Disallow */lazy.js
Disallow */breakingnews.js
Disallow */rodate.js
Disallow */mail/*
Disallow */profileshow/*
Disallow */tpoint_articleshow/*
Disallow */trivia/*
Disallow */articleshowajax/*
Disallow /articlecomment/
Disallow /artshowcmt/
Disallow /7176/TOI_Travel/
Disallow /search
Disallow /fbpostaction.cms?article=
Disallow /7176/TOI_Travel_Test/TOI_Travel_TOP_TST
Disallow /postmail.cms
Disallow /mostviewed
Disallow /related
Disallow /comments
Disallow *Jai-Mrug*
Disallow */affiliate_amazon.cms*
Disallow *-mostviwed*
Disallow */techgadgets/*
Disallow */covid-19-delhi/*
Disallow */covid-19-bangalore/*
Disallow */covid-19-hyderabad/*
Disallow */covid-19-kolkata/*
Disallow */covid-19-mumbai/*
Disallow */covid-19-across-world/*
Disallow */crshow/*
Disallow */briefs/articleid-*
Disallow /intarnel/*
Disallow */dynalist/*
Disallow */amp_msp_amazon_gadget.cms*
Disallow */affiliates_content_iframe.cms*
Disallow */affiliates_content.cms*
Disallow */affiliates_content_iframe*
Disallow */affiliates_library*
Disallow */affiliates_content*
Disallow */ifrmwdt/*
Disallow *articleshowbriefs*
Disallow *quickstirshow*
Disallow *mobile%3Dno*
Disallow *etarticleshow*

googlebot-news

Rule Path
Allow /
Disallow /PDATOI/
Disallow /topic/quote/
Disallow /*cms.dll*
Disallow /*rssarticleshow*
Disallow /topic/photo/
Disallow /default.cms
Disallow /default1.cms
Disallow /artshowcmt/
Disallow */opinions/
Disallow /breakingnews/toihome.html
Disallow /topic/article/
Disallow /logtopickeywords*
Disallow /new_cmtofart*
Disallow /pmcomment/
Disallow /feeds/
Disallow */configspace/*
Disallow /configspace/maintenance.html
Disallow /topiclist/
Disallow */pmredirectshow/*
Disallow */stoi/*
Disallow */moviearticlelistalphabet1/*
Disallow */cinema-entertainment/*
Disallow */life-style-landing/*
Disallow *navlvl%3D
Disallow /lspoll/
Disallow *query%3D
Disallow /beta_hotlydbt/
Disallow *defalpha%3D
Disallow *%2Cpage
Disallow /new_cmtofart2_nit_v1/
Disallow *prtpage
Disallow */examshow/*
Disallow */speednewsshow/*
Disallow */speednewsbytopic/*
Disallow */itslideshow/*
Disallow */vsarticleshow/*
Disallow */articleshow_amitr/*
Disallow */pmtoinavigation/*
Disallow */mvopinions/*
Disallow */opinionslogged/*
Disallow */rodate.js
Disallow */load.js
Disallow */cookie.js
Disallow */jquery.js
Disallow */navigation.js
Disallow */pgtrack.js
Disallow */lazy.js
Disallow */breakingnews.js
Disallow */rodate.js
Disallow */mail/*
Disallow */profileshow/*
Disallow */tpoint_articleshow/*
Disallow */trivia/*
Disallow */articleshowajax/*
Disallow /articlecomment/
Disallow /artshowcmt/
Disallow /7176/TOI_Travel/
Disallow /search
Disallow /fbpostaction.cms?article=
Disallow /7176/TOI_Travel_Test/TOI_Travel_TOP_TST
Disallow /postmail.cms
Disallow /mostviewed
Disallow /related
Disallow /comments
Disallow *Jai-Mrug*
Disallow */affiliate_amazon.cms*
Disallow *-mostviwed*
Disallow */techgadgets/*
Disallow */covid-19-delhi/*
Disallow */covid-19-bangalore/*
Disallow */covid-19-hyderabad/*
Disallow */covid-19-kolkata/*
Disallow */covid-19-mumbai/*
Disallow */covid-19-across-world/*
Disallow */crshow/*
Disallow */briefs/articleid-*
Disallow /intarnel/*
Disallow */dynalist/*
Disallow */amp_msp_amazon_gadget.cms*
Disallow */affiliates_content_iframe.cms*
Disallow */affiliates_content.cms*
Disallow */affiliates_content_iframe*
Disallow */affiliates_library*
Disallow */affiliates_content*
Disallow */ifrmwdt/*
Disallow *articleshowbriefs*
Disallow *quickstirshow*
Disallow *mobile%3Dno*
Disallow *etarticleshow*

gptbot

Rule Path
Disallow /