maharashtratimes.com
robots.txt
Robots Exclusion Standard data for maharashtratimes.com
Resource Scan
Scan Details
| Site Domain | maharashtratimes.com |
| Base Domain | maharashtratimes.com |
| Scan Status | Ok |
| Last Scan | 2024-05-23T19:32:05+00:00 |
| Next Scan | 2024-05-30T19:32:05+00:00 |
Last Scan
| Scanned | 2024-05-23T19:32:05+00:00 |
| URL | https://maharashtratimes.com/robots.txt |
| Domain IPs | 184.50.85.147, 184.50.85.162, 2600:1417:3f::b81c:eb38, 2600:1417:3f::b81c:eb41 |
| Response IP | 184.50.85.147 |
| Found | Yes |
| Hash | c1e9363a0b39abe2ec43041f122228248c21c35ff6f750ff438bbbe7368dc0e3 |
| SimHash | 35580969af93 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /aapla-bajar/ |
| Disallow | /?back=1 |
| Disallow | */xml/ |
| Disallow | /7176/ |
| Disallow | */videoplayer |
| Disallow | */tech/mobile-phones/ |
| Disallow | */tech/tablets/ |
| Disallow | */tech/smartwatch/ |
| Disallow | */tech/ac/ |
| Disallow | */tech/television/ |
| Disallow | */tech/laptops/ |
| Disallow | */tech/refrigerator/ |
| Disallow | */tech/washingmachine/ |
| Disallow | */tech/cameras/ |
| Disallow | */smartwatch/ |
| Disallow | */ac/ |
| Disallow | */television/ |
| Disallow | */laptops/ |
| Disallow | */refrigerator/ |
| Disallow | */washingmachine/ |
| Disallow | */cameras/ |
| Disallow | */powerbank/ |
| Disallow | */tech/powerbank/ |
| Disallow | */tech/fitnessband/ |
| Disallow | */compare-ac/ |
| Disallow | */compare-television/ |
| Disallow | */compare-laptops/ |
| Disallow | */compare-refrigerator/ |
| Disallow | */compare-washingmachine/ |
| Disallow | */compare-cameras/ |
| Disallow | */compare-powerbank/ |
| Disallow | */fitnessband/ |
| Disallow | */tablets/ |
| Disallow | */tech/compare-television/ |
| Disallow | */tech/compare-laptops/ |
| Disallow | */tech/compare-refrigerator/ |
| Disallow | */tech/compare-washingmachine/ |
| Disallow | */tech/compare-cameras/ |
| Disallow | */tech/compare-powerbank/ |
| Disallow | */compare-fitnessband/ |
| Disallow | */compare-mobile-phones/ |
| Disallow | */compare-tablets/ |
| Disallow | */compare-smartwatch/ |
| Disallow | */tech/compare-fitnessband/ |
| Disallow | */tech/compare-mobile-phones/ |
| Disallow | */tech/compare-tablets/ |
| Disallow | */tech/compare-smartwatch/ |
| Disallow | */tech/compare-ac/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://marathi.indiatimes.com/sitemap/today |
| sitemap | https://marathi.indiatimes.com/sitemap/yesterday |
| sitemap | https://marathi.indiatimes.com/sitemapxml.cms |
| sitemap | https://marathi.indiatimes.com/staticsitemap/mt/sitemap-index.xml |
| sitemap | https://marathi.indiatimes.com/amp_stories/amp_web_stories_sitemap.cms |
| sitemap | https://marathi.indiatimes.com/langapi/sitemap/topics-sitemap/106204687.xml |
| sitemap | https://marathi.indiatimes.com/elections/static_content/constituencyloksabha_mt.xml |
| sitemap | https://marathi.indiatimes.com/langapi/sitemap/topics-sitemap/79262018.xml |