marathi.economictimes.com
robots.txt

Robots Exclusion Standard data for marathi.economictimes.com

Resource Scan

Scan Details

Site Domain marathi.economictimes.com
Base Domain economictimes.com
Scan Status Ok
Last Scan2024-04-26T02:01:03+00:00
Next Scan 2024-05-26T02:01:03+00:00

Last Scan

Scanned2024-04-26T02:01:03+00:00
URL https://marathi.economictimes.com/robots.txt
Domain IPs 2600:1413:b000:1c::17d1:2ecc, 2600:1413:b000:1c::17d1:2ed3, 96.17.180.172, 96.17.180.24
Response IP 184.50.85.131
Found Yes
Hash caf6a2b9b959b99602530f6a439d9cbf51656dedf8e65b1a4ce2c7b35c994352
SimHash 2b4cc833a793

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Allow
Disallow /7176/

Other Records

Field Value
sitemap https://marathi.economictimes.com/sitemap/sitemapxml.cms
sitemap https://marathi.economictimes.com/sitemap/newssitemap.cms
sitemap https://marathi.economictimes.com/sitemap/today
sitemap https://marathi.economictimes.com/sitemap/yesterday
sitemap https://marathi.economictimes.com/sitemap/24hours
sitemap https://marathi.economictimes.com/sitemap/stocksitemap.cms
sitemap https://marathi.economictimes.com/sitemap/mutualfundsitemap.cms
sitemap https://marathi.economictimes.com/sitemap/commoditysitemap.cms
sitemap https://marathi.economictimes.com/staticsitemap/etmarathi/sitemap-index.xml