economictimes.com
robots.txt

Robots Exclusion Standard data for economictimes.com

Resource Scan

Scan Details

Site Domain economictimes.com
Base Domain economictimes.com
Scan Status Ok
Last Scan2024-05-10T14:13:16+00:00
Next Scan 2024-05-17T14:13:16+00:00

Last Scan

Scanned2024-05-10T14:13:16+00:00
URL https://economictimes.com/robots.txt
Redirect https://economictimes.indiatimes.com/robots.txt
Redirect Domain economictimes.indiatimes.com
Redirect Base indiatimes.com
Domain IPs 2600:1413:a000::1734:2888, 2600:1413:a000::1734:2891, 96.17.180.151, 96.17.180.190
Redirect IPs 23.59.168.123, 2600:1413:b000:e::b833:6d2, 2600:1413:b000:e::b833:6da
Response IP 184.50.85.137
Found Yes
Hash fca65440e96a5f9e1a44f07b8cef527c48932a46f7205b74329ba87694a56eee
SimHash 4a2f3a3a34b7

Groups

*

Rule Path
Allow /
Disallow /PDAET/
Disallow /7176/
Disallow */notify.htm?*
Disallow /default1.cms
Disallow /default.cms
Disallow /*rssarticleshow*
Disallow /*cms.dll*
Disallow /*/opinions/
Disallow /pmcomment/
Disallow /logtopickeywords.cms
Disallow /logtopickeywords.cms?query=
Disallow /researchview.cms?searchid=
Disallow /researchviewcomm.cms?searchid=
Disallow /articleshow_cmtofartac/
Disallow /cmtofart/
Disallow /cmtofartac_lp/
Disallow /comments/
Disallow /comment/
Disallow /announcements.cms
Disallow /analysis.cms
Disallow *?adcode=*
Disallow /etvertical_articleshow/
Disallow /articleshow1/
Disallow */params/smecompany/entityid-*
Disallow /smelistings*
Disallow *primeshow*
Disallow */login.cms*
Disallow /topic/*/photos*
Disallow /topic/*/ampphoto*
Disallow */topics_amp/*
Disallow /top-trending-products/*/primearticleshow/*
Disallow /etvertical_taglist*
Disallow */hindi/*
Disallow *?language=HIN
Disallow *%2Clanguage-HIN.cms
Disallow *?language=BEN
Disallow *%2Clanguage-BEN.cms
Disallow *?language=GUJ
Disallow *%2Clanguage-GUJ.cms
Disallow *?language=MAR
Disallow *%2Clanguage-MAR.cms
Disallow *?language=TAM
Disallow *%2Clanguage-TAM.cms
Disallow *?language=TEL
Disallow *%2Clanguage-TEL.cms
Disallow *?language=MAL
Disallow *%2Clanguage-MAL.cms
Disallow *?language=KAN
Disallow *%2Clanguage-KAN.cms
Disallow */blogs/*

googlebot-news

Rule Path
Allow /
Disallow /PDAET/
Disallow /7176/
Disallow */notify.htm?*
Disallow /default1.cms
Disallow /default.cms
Disallow /*rssarticleshow*
Disallow /*cms.dll*
Disallow /*/opinions/
Disallow /pmcomment/
Disallow /logtopickeywords.cms
Disallow /logtopickeywords.cms?query=
Disallow /researchview.cms?searchid=
Disallow /researchviewcomm.cms?searchid=
Disallow /articleshow_cmtofartac/
Disallow /cmtofart/
Disallow /cmtofartac_lp/
Disallow /comments/
Disallow /comment/
Disallow /announcements.cms
Disallow /analysis.cms
Disallow *?adcode=*
Disallow /etvertical_articleshow/
Disallow /articleshow1/
Disallow */params/smecompany/entityid-*
Disallow /smelistings*
Disallow *primeshow*
Disallow */login.cms*
Disallow /topic/*/photos*
Disallow /topic/*/ampphoto*
Disallow */topics_amp/*
Disallow /top-trending-products/*/primearticleshow/*
Disallow /etvertical_taglist*
Disallow */hindi/*
Disallow *?language=HIN
Disallow *%2Clanguage-HIN.cms
Disallow *?language=BEN
Disallow *%2Clanguage-BEN.cms
Disallow *?language=GUJ
Disallow *%2Clanguage-GUJ.cms
Disallow *?language=MAR
Disallow *%2Clanguage-MAR.cms
Disallow *?language=TAM
Disallow *%2Clanguage-TAM.cms
Disallow *?language=TEL
Disallow *%2Clanguage-TEL.cms
Disallow *?language=MAL
Disallow *%2Clanguage-MAL.cms
Disallow *?language=KAN
Disallow *%2Clanguage-KAN.cms
Disallow */blogs/*

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://economictimes.indiatimes.com/companylisting.cms
sitemap https://economictimes.indiatimes.com/newssitemapindex.cms
sitemap https://economictimes.indiatimes.com/etstatic/sitemaps/et/sitemap-index.xml
sitemap https://economictimes.indiatimes.com/sitemapxml.cms
sitemap https://economictimes.indiatimes.com/etstatic/sitemaps/etvideo/sitemap-index.xml
sitemap https://economictimes.indiatimes.com/sitemap/today
sitemap https://economictimes.indiatimes.com/sitemap/yesterday
sitemap https://economictimes.indiatimes.com/companylisting.cms
sitemap https://economictimes.indiatimes.com/newssitemapindex.cms
sitemap https://economictimes.indiatimes.com/etstatic/sitemaps/et/sitemap-index.xml
sitemap https://economictimes.indiatimes.com/sitemapxml.cms
sitemap https://economictimes.indiatimes.com/etstatic/sitemaps/etvideo/sitemap-index.xml
sitemap https://economictimes.indiatimes.com/sitemap/today
sitemap https://economictimes.indiatimes.com/sitemap/yesterday