timescrest.com
robots.txt
Robots Exclusion Standard data for timescrest.com
Resource Scan
Scan Details
| Site Domain | timescrest.com |
| Base Domain | timescrest.com |
| Scan Status | Ok |
| Last Scan | 2024-06-02T00:57:30+00:00 |
| Next Scan | 2024-07-02T00:57:30+00:00 |
Last Scan
| Scanned | 2024-06-02T00:57:30+00:00 |
| URL | http://timescrest.com/robots.txt |
| Redirect | http://timesofindia.indiatimes.com/robots.txt |
| Redirect Domain | timesofindia.indiatimes.com |
| Redirect Base | indiatimes.com |
| Domain IPs | 208.80.122.182, 208.80.122.93, 208.80.123.217, 208.80.123.36, 2600:1803:10a::61, 2600:1803:10b::49, 2600:1803:10c::9, 2600:1803:10d::29 |
| Redirect IPs | 184.50.85.137, 184.50.85.138, 184.50.85.139, 184.50.85.146, 184.50.85.153, 184.50.85.156, 184.50.85.162, 184.50.85.171, 2600:1413:b000:1c::17d1:2ec6, 2600:1413:b000:1c::17d1:2ed9, 96.17.180.185 |
| Response IP | 184.50.85.138 |
| Found | Yes |
| Hash | 48944dddf4378623b5511a38d33ef397e0d0a8b82ae9d2ce04dbdaee4ebbb4e1 |
| SimHash | 6304d1266410 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /PDATOI/ |
| Disallow | /topic/quote/ |
| Disallow | /*cms.dll* |
| Disallow | /*rssarticleshow* |
| Disallow | /topic/photo/ |
| Disallow | /default.cms |
| Disallow | /default1.cms |
| Disallow | /artshowcmt/ |
| Disallow | */opinions/ |
| Disallow | /breakingnews/toihome.html |
| Disallow | /topic/article/ |
| Disallow | /logtopickeywords* |
| Disallow | /new_cmtofart* |
| Disallow | /pmcomment/ |
| Disallow | /feeds/ |
| Disallow | */configspace/* |
| Disallow | /configspace/maintenance.html |
| Disallow | /topiclist/ |
| Disallow | */pmredirectshow/* |
| Disallow | */stoi/* |
| Disallow | */moviearticlelistalphabet1/* |
| Disallow | */cinema-entertainment/* |
| Disallow | */life-style-landing/* |
| Disallow | *navlvl%3D |
| Disallow | /lspoll/ |
| Disallow | *query%3D |
| Disallow | /beta_hotlydbt/ |
| Disallow | *defalpha%3D |
| Disallow | *%2Cpage |
| Disallow | /new_cmtofart2_nit_v1/ |
| Disallow | *prtpage |
| Disallow | */examshow/* |
| Disallow | */speednewsshow/* |
| Disallow | */speednewsbytopic/* |
| Disallow | */itslideshow/* |
| Disallow | */vsarticleshow/* |
| Disallow | */articleshow_amitr/* |
| Disallow | */pmtoinavigation/* |
| Disallow | */mvopinions/* |
| Disallow | */opinionslogged/* |
| Disallow | */rodate.js |
| Disallow | */load.js |
| Disallow | */cookie.js |
| Disallow | */jquery.js |
| Disallow | */navigation.js |
| Disallow | */pgtrack.js |
| Disallow | */lazy.js |
| Disallow | */breakingnews.js |
| Disallow | */rodate.js |
| Disallow | */mail/* |
| Disallow | */profileshow/* |
| Disallow | */tpoint_articleshow/* |
| Disallow | */trivia/* |
| Disallow | */articleshowajax/* |
| Disallow | /articlecomment/ |
| Disallow | /artshowcmt/ |
| Disallow | /7176/TOI_Travel/ |
| Disallow | /search |
| Disallow | /fbpostaction.cms?article= |
| Disallow | /7176/TOI_Travel_Test/TOI_Travel_TOP_TST |
| Disallow | /postmail.cms |
| Disallow | /mostviewed |
| Disallow | /related |
| Disallow | /comments |
| Disallow | *Jai-Mrug* |
| Disallow | */affiliate_amazon.cms* |
| Disallow | *-mostviwed* |
| Disallow | */techgadgets/* |
| Disallow | */covid-19-delhi/* |
| Disallow | */covid-19-bangalore/* |
| Disallow | */covid-19-hyderabad/* |
| Disallow | */covid-19-kolkata/* |
| Disallow | */covid-19-mumbai/* |
| Disallow | */covid-19-across-world/* |
| Disallow | */crshow/* |
| Disallow | */briefs/articleid-* |
| Disallow | /intarnel/* |
| Disallow | */dynalist/* |
| Disallow | */amp_msp_amazon_gadget.cms* |
| Disallow | */affiliates_content_iframe.cms* |
| Disallow | */affiliates_content.cms* |
| Disallow | */affiliates_content_iframe* |
| Disallow | */affiliates_library* |
| Disallow | */affiliates_content* |
| Disallow | */ifrmwdt/* |
| Disallow | *articleshowbriefs* |
| Disallow | *quickstirshow* |
| Disallow | *mobile%3Dno* |
| Disallow | *etarticleshow* |
googlebot-news
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /PDATOI/ |
| Disallow | /topic/quote/ |
| Disallow | /*cms.dll* |
| Disallow | /*rssarticleshow* |
| Disallow | /topic/photo/ |
| Disallow | /default.cms |
| Disallow | /default1.cms |
| Disallow | /artshowcmt/ |
| Disallow | */opinions/ |
| Disallow | /breakingnews/toihome.html |
| Disallow | /topic/article/ |
| Disallow | /logtopickeywords* |
| Disallow | /new_cmtofart* |
| Disallow | /pmcomment/ |
| Disallow | /feeds/ |
| Disallow | */configspace/* |
| Disallow | /configspace/maintenance.html |
| Disallow | /topiclist/ |
| Disallow | */pmredirectshow/* |
| Disallow | */stoi/* |
| Disallow | */moviearticlelistalphabet1/* |
| Disallow | */cinema-entertainment/* |
| Disallow | */life-style-landing/* |
| Disallow | *navlvl%3D |
| Disallow | /lspoll/ |
| Disallow | *query%3D |
| Disallow | /beta_hotlydbt/ |
| Disallow | *defalpha%3D |
| Disallow | *%2Cpage |
| Disallow | /new_cmtofart2_nit_v1/ |
| Disallow | *prtpage |
| Disallow | */examshow/* |
| Disallow | */speednewsshow/* |
| Disallow | */speednewsbytopic/* |
| Disallow | */itslideshow/* |
| Disallow | */vsarticleshow/* |
| Disallow | */articleshow_amitr/* |
| Disallow | */pmtoinavigation/* |
| Disallow | */mvopinions/* |
| Disallow | */opinionslogged/* |
| Disallow | */rodate.js |
| Disallow | */load.js |
| Disallow | */cookie.js |
| Disallow | */jquery.js |
| Disallow | */navigation.js |
| Disallow | */pgtrack.js |
| Disallow | */lazy.js |
| Disallow | */breakingnews.js |
| Disallow | */rodate.js |
| Disallow | */mail/* |
| Disallow | */profileshow/* |
| Disallow | */tpoint_articleshow/* |
| Disallow | */trivia/* |
| Disallow | */articleshowajax/* |
| Disallow | /articlecomment/ |
| Disallow | /artshowcmt/ |
| Disallow | /7176/TOI_Travel/ |
| Disallow | /search |
| Disallow | /fbpostaction.cms?article= |
| Disallow | /7176/TOI_Travel_Test/TOI_Travel_TOP_TST |
| Disallow | /postmail.cms |
| Disallow | /mostviewed |
| Disallow | /related |
| Disallow | /comments |
| Disallow | *Jai-Mrug* |
| Disallow | */affiliate_amazon.cms* |
| Disallow | *-mostviwed* |
| Disallow | */techgadgets/* |
| Disallow | */covid-19-delhi/* |
| Disallow | */covid-19-bangalore/* |
| Disallow | */covid-19-hyderabad/* |
| Disallow | */covid-19-kolkata/* |
| Disallow | */covid-19-mumbai/* |
| Disallow | */covid-19-across-world/* |
| Disallow | */crshow/* |
| Disallow | */briefs/articleid-* |
| Disallow | /intarnel/* |
| Disallow | */dynalist/* |
| Disallow | */amp_msp_amazon_gadget.cms* |
| Disallow | */affiliates_content_iframe.cms* |
| Disallow | */affiliates_content.cms* |
| Disallow | */affiliates_content_iframe* |
| Disallow | */affiliates_library* |
| Disallow | */affiliates_content* |
| Disallow | */ifrmwdt/* |
| Disallow | *articleshowbriefs* |
| Disallow | *quickstirshow* |
| Disallow | *mobile%3Dno* |
| Disallow | *etarticleshow* |