bengali.economictimes.com
robots.txt
Robots Exclusion Standard data for bengali.economictimes.com
Resource Scan
Scan Details
| Site Domain | bengali.economictimes.com |
| Base Domain | economictimes.com |
| Scan Status | Ok |
| Last Scan | 2024-09-14T12:55:58+00:00 |
| Next Scan | 2024-09-28T12:55:58+00:00 |
Last Scan
| Scanned | 2024-09-14T12:55:58+00:00 |
| URL | https://bengali.economictimes.com/robots.txt |
| Domain IPs | 184.50.85.131, 2600:1413:b000:1c::17d1:2ed4, 2600:1413:b000:1c::17d1:2edb, 96.17.180.172 |
| Response IP | 184.50.85.131 |
| Found | Yes |
| Hash | 9e3053e9775ae9a004970238539f32418b39eb2b45f3cad1f54ab4512f068315 |
| SimHash | 484053f4e1a2 |
Groups
*
| Rule | Path |
|---|---|
| Allow | |
| Disallow | *?back=1 |
| Disallow | */xml/* |
| Disallow | */7176/* |
| Disallow | */stockreports/* |
| Disallow | */infocompanybackground/* |
| Disallow | */infocompanylisting/* |
| Disallow | */quotecompare/* |
| Disallow | */shareholding/* |
| Disallow | */chairmanspeech/* |
| Disallow | */infocompanybonus/* |
| Disallow | */stocksupdate/* |
| Disallow | */infocompanydividends/* |
| Disallow | */infocompanyagm/* |
| Disallow | */ninemonthly/* |
| Disallow | */infocompanyrights/* |
| Disallow | */infocompanysplits/* |
| Disallow | */halfyearly/* |
| Disallow | */infocompanyhistory/* |
| Disallow | */infocompanyboardmeetings/* |
| Disallow | */directorsreport/* |
| Disallow | */profitandlose/* |
| Disallow | */infocompanylocations/* |
| Disallow | */finishedproducts/* |
| Disallow | */balancesheet/* |
| Disallow | */prices/* |
| Disallow | */cashflow/* |
| Disallow | */capitalstructure/* |
| Disallow | */yearly/* |
| Disallow | */quarterly/* |
| Disallow | */infocompanymanagement/* |
| Disallow | */videoplayer.cms? |
| Disallow | */undefined/ |
| Disallow | */pwafeeds/ |
| Disallow | *?utm_source |
| Disallow | *?trc_source |
| Disallow | *?_gl= |
| Disallow | *?frmapp=yes |
| Disallow | */login.cms? |
| Disallow | */feeds/vod_player.cms? |
| Disallow | */search?query= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://bengali.economictimes.com/sitemap/today |
| sitemap | https://bengali.economictimes.com/sitemap/24hours |
| sitemap | https://bengali.economictimes.com/sitemap/yesterday |
| sitemap | https://bengali.economictimes.com/sitemap/newssitemap.cms |
| sitemap | https://bengali.economictimes.com/sitemap/sitemapxml.cms |