timescrest.com
robots.txt
Robots Exclusion Standard data for timescrest.com
Resource Scan
Scan Details
| Site Domain | timescrest.com |
| Base Domain | timescrest.com |
| Scan Status | Ok |
| Last Scan | 2024-08-31T00:58:10+00:00 |
| Next Scan | 2024-09-30T00:58:10+00:00 |
Last Scan
| Scanned | 2024-08-31T00:58:10+00:00 |
| URL | http://timescrest.com/robots.txt |
| Redirect | http://timesofindia.indiatimes.com/robots.txt |
| Redirect Domain | timesofindia.indiatimes.com |
| Redirect Base | indiatimes.com |
| Domain IPs | 208.80.122.182, 208.80.122.93, 208.80.123.217, 208.80.123.36, 2600:1803:10a::61, 2600:1803:10b::49, 2600:1803:10c::9, 2600:1803:10d::29 |
| Redirect IPs | 23.215.7.5, 23.215.7.7, 2600:1413:b000:1c::17d1:2ec6, 2600:1413:b000:1c::17d1:2ee1 |
| Response IP | 184.50.85.147 |
| Found | Yes |
| Hash | 7035d67ba0426da7a174a4db33c5b995b8e42c9e2078c932be68702f9a761ead |
| SimHash | 6004d1266098 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /PDATOI/ |
| Disallow | /topic/quote/ |
| Disallow | /*cms.dll* |
| Disallow | /*rssarticleshow* |
| Disallow | /topic/photo/ |
| Disallow | /default.cms |
| Disallow | /default1.cms |
| Disallow | /artshowcmt/ |
| Disallow | */opinions/ |
| Disallow | /breakingnews/toihome.html |
| Disallow | /topic/article/ |
| Disallow | /logtopickeywords* |
| Disallow | /new_cmtofart* |
| Disallow | /pmcomment/ |
| Disallow | /feeds/ |
| Disallow | */configspace/* |
| Disallow | /configspace/maintenance.html |
| Disallow | /topiclist/ |
| Disallow | */pmredirectshow/* |
| Disallow | */stoi/* |
| Disallow | */moviearticlelistalphabet1/* |
| Disallow | */cinema-entertainment/* |
| Disallow | */life-style-landing/* |
| Disallow | *navlvl%3D |
| Disallow | /lspoll/ |
| Disallow | *query%3D |
| Disallow | /beta_hotlydbt/ |
| Disallow | *defalpha%3D |
| Disallow | *%2Cpage |
| Disallow | /new_cmtofart2_nit_v1/ |
| Disallow | *prtpage |
| Disallow | */examshow/* |
| Disallow | */speednewsshow/* |
| Disallow | */speednewsbytopic/* |
| Disallow | */itslideshow/* |
| Disallow | */vsarticleshow/* |
| Disallow | */articleshow_amitr/* |
| Disallow | */pmtoinavigation/* |
| Disallow | */mvopinions/* |
| Disallow | */opinionslogged/* |
| Disallow | */rodate.js |
| Disallow | */load.js |
| Disallow | */cookie.js |
| Disallow | */jquery.js |
| Disallow | */navigation.js |
| Disallow | */pgtrack.js |
| Disallow | */lazy.js |
| Disallow | */breakingnews.js |
| Disallow | */rodate.js |
| Disallow | */mail/* |
| Disallow | */profileshow/* |
| Disallow | */tpoint_articleshow/* |
| Disallow | */trivia/* |
| Disallow | */articleshowajax/* |
| Disallow | /articlecomment/ |
| Disallow | /artshowcmt/ |
| Disallow | /7176/TOI_Travel/ |
| Disallow | /search |
| Disallow | /fbpostaction.cms?article= |
| Disallow | /7176/TOI_Travel_Test/TOI_Travel_TOP_TST |
| Disallow | /postmail.cms |
| Disallow | /mostviewed |
| Disallow | /related |
| Disallow | /comments |
| Disallow | *Jai-Mrug* |
| Disallow | */affiliate_amazon.cms* |
| Disallow | *-mostviwed* |
| Disallow | */techgadgets/* |
| Disallow | */covid-19-delhi/* |
| Disallow | */covid-19-bangalore/* |
| Disallow | */covid-19-hyderabad/* |
| Disallow | */covid-19-kolkata/* |
| Disallow | */covid-19-mumbai/* |
| Disallow | */covid-19-across-world/* |
| Disallow | */crshow/* |
| Disallow | */briefs/articleid-* |
| Disallow | /intarnel/* |
| Disallow | */dynalist/* |
| Disallow | */amp_msp_amazon_gadget.cms* |
| Disallow | */affiliates_content_iframe.cms* |
| Disallow | */affiliates_content.cms* |
| Disallow | */affiliates_content_iframe* |
| Disallow | */affiliates_library* |
| Disallow | */affiliates_content* |
| Disallow | */ifrmwdt/* |
| Disallow | *articleshowbriefs* |
| Disallow | *quickstirshow* |
| Disallow | *mobile%3Dno* |
| Disallow | *etarticleshow* |
| Disallow | *?mobile=no* |
| Disallow | *homeajax_nav.cms?* |
| Disallow | *articleshowbriefs?* |
| Disallow | *affiliates_content_iframe_v2* |
| Disallow | *?frmapp=yes* |
| Disallow | *embedvideo.cms* |
| Disallow | *videodash.cms* |
| Disallow | *etopneinappamp.cms* |
| Disallow | *as_comments* |
| Disallow | *RBP_HOME_URL* |
| Disallow | *?comments* |
| Disallow | *?showcomment* |
| Disallow | *?cmfid* |
| Disallow | *?pg=* |
| Disallow | *?ps=* |
| Disallow | *articleshow_new* |
| Disallow | *articleshowprint* |
| Disallow | /microsite_v2 |
| Disallow | */undefined$ |
| Disallow | */articleshowhsbc/ |
| Disallow | */storylist/ |
| Disallow | *asrelated.cms* |
googlebot-news
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /PDATOI/ |
| Disallow | /topic/quote/ |
| Disallow | /*cms.dll* |
| Disallow | /*rssarticleshow* |
| Disallow | /topic/photo/ |
| Disallow | /default.cms |
| Disallow | /default1.cms |
| Disallow | /artshowcmt/ |
| Disallow | */opinions/ |
| Disallow | /breakingnews/toihome.html |
| Disallow | /topic/article/ |
| Disallow | /logtopickeywords* |
| Disallow | /new_cmtofart* |
| Disallow | /pmcomment/ |
| Disallow | /feeds/ |
| Disallow | */configspace/* |
| Disallow | /configspace/maintenance.html |
| Disallow | /topiclist/ |
| Disallow | */pmredirectshow/* |
| Disallow | */stoi/* |
| Disallow | */moviearticlelistalphabet1/* |
| Disallow | */cinema-entertainment/* |
| Disallow | */life-style-landing/* |
| Disallow | *navlvl%3D |
| Disallow | /lspoll/ |
| Disallow | *query%3D |
| Disallow | /beta_hotlydbt/ |
| Disallow | *defalpha%3D |
| Disallow | *%2Cpage |
| Disallow | /new_cmtofart2_nit_v1/ |
| Disallow | *prtpage |
| Disallow | */examshow/* |
| Disallow | */speednewsshow/* |
| Disallow | */speednewsbytopic/* |
| Disallow | */itslideshow/* |
| Disallow | */vsarticleshow/* |
| Disallow | */articleshow_amitr/* |
| Disallow | */pmtoinavigation/* |
| Disallow | */mvopinions/* |
| Disallow | */opinionslogged/* |
| Disallow | */rodate.js |
| Disallow | */load.js |
| Disallow | */cookie.js |
| Disallow | */jquery.js |
| Disallow | */navigation.js |
| Disallow | */pgtrack.js |
| Disallow | */lazy.js |
| Disallow | */breakingnews.js |
| Disallow | */rodate.js |
| Disallow | */mail/* |
| Disallow | */profileshow/* |
| Disallow | */tpoint_articleshow/* |
| Disallow | */trivia/* |
| Disallow | */articleshowajax/* |
| Disallow | /articlecomment/ |
| Disallow | /artshowcmt/ |
| Disallow | /7176/TOI_Travel/ |
| Disallow | /search |
| Disallow | /fbpostaction.cms?article= |
| Disallow | /7176/TOI_Travel_Test/TOI_Travel_TOP_TST |
| Disallow | /postmail.cms |
| Disallow | /mostviewed |
| Disallow | /related |
| Disallow | /comments |
| Disallow | *Jai-Mrug* |
| Disallow | */affiliate_amazon.cms* |
| Disallow | *-mostviwed* |
| Disallow | */techgadgets/* |
| Disallow | */covid-19-delhi/* |
| Disallow | */covid-19-bangalore/* |
| Disallow | */covid-19-hyderabad/* |
| Disallow | */covid-19-kolkata/* |
| Disallow | */covid-19-mumbai/* |
| Disallow | */covid-19-across-world/* |
| Disallow | */crshow/* |
| Disallow | */briefs/articleid-* |
| Disallow | /intarnel/* |
| Disallow | */dynalist/* |
| Disallow | */amp_msp_amazon_gadget.cms* |
| Disallow | */affiliates_content_iframe.cms* |
| Disallow | */affiliates_content.cms* |
| Disallow | */affiliates_content_iframe* |
| Disallow | */affiliates_library* |
| Disallow | */affiliates_content* |
| Disallow | */ifrmwdt/* |
| Disallow | *articleshowbriefs* |
| Disallow | *quickstirshow* |
| Disallow | *mobile%3Dno* |
| Disallow | *etarticleshow* |
| Disallow | *?mobile=no* |
| Disallow | *homeajax_nav.cms?* |
| Disallow | *articleshowbriefs?* |
| Disallow | *affiliates_content_iframe_v2* |
| Disallow | *?frmapp=yes* |
| Disallow | *embedvideo.cms* |
| Disallow | *videodash.cms* |
| Disallow | *etopneinappamp.cms* |
| Disallow | *as_comments* |
| Disallow | *RBP_HOME_URL* |
| Disallow | *?comments* |
| Disallow | *?showcomment* |
| Disallow | *?cmfid* |
| Disallow | *?pg=* |
| Disallow | *?ps=* |
| Disallow | *articleshow_new* |
| Disallow | *articleshowprint* |
| Disallow | /microsite_v2 |
| Disallow | */undefined$ |
| Disallow | */articleshowhsbc/ |
| Disallow | */storylist/ |
| Disallow | *asrelated.cms* |