www.navbharattimes.indiatimes.com
robots.txt
Robots Exclusion Standard data for www.navbharattimes.indiatimes.com
Resource Scan
Scan Details
Site Domain | www.navbharattimes.indiatimes.com |
Base Domain | indiatimes.com |
Scan Status | Ok |
Last Scan | 2024-05-08T09:29:02+00:00 |
Next Scan | 2024-05-22T09:29:02+00:00 |
Last Scan
Scanned | 2024-05-08T09:29:02+00:00 |
URL | https://www.navbharattimes.indiatimes.com/robots.txt |
Domain IPs | 184.50.85.137, 184.50.85.139, 184.50.85.147, 184.50.85.148, 184.50.85.162, 2600:1413:b000:1c::17d1:2ec6, 2600:1413:b000:1c::17d1:2ed9, 96.17.180.171, 96.17.180.179, 96.17.180.182, 96.17.180.26 |
Response IP | 184.50.85.147 |
Found | Yes |
Hash | a209a47c701431e83918a7429c42b0737883273478eeaaa4b091197a953a4768 |
SimHash | 30dc1963c791 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Allow | */apna-bazaar/* |
Allow | */top-rated-products/* |
Disallow | /?back=1 |
Disallow | */xml/ |
Disallow | /7176/ |
Disallow | */navbharatgold/horoscope/ |
Disallow | */navbharatgold/sports/ |
Disallow | */navbharatgold/life/ |
Disallow | */topics/ |
Disallow | */topic/ |
Disallow | */tech/mobile-phones/ |
Disallow | */tech/tablets/ |
Disallow | */tech/smartwatch/ |
Disallow | */tech/ac/ |
Disallow | */tech/television/ |
Disallow | */tech/laptops/ |
Disallow | */tech/refrigerator/ |
Disallow | */tech/washingmachine/ |
Disallow | */tech/cameras/ |
Disallow | */smartwatch/ |
Disallow | */ac/ |
Disallow | */television/ |
Disallow | */laptops/ |
Disallow | */refrigerator/ |
Disallow | */washingmachine/ |
Disallow | */cameras/ |
Disallow | */powerbank/ |
Disallow | */tech/powerbank/ |
Disallow | */tech/fitnessband/ |
Disallow | */compare-ac/ |
Disallow | */compare-television/ |
Disallow | */compare-laptops/ |
Disallow | */compare-refrigerator/ |
Disallow | */compare-washingmachine/ |
Disallow | */compare-cameras/ |
Disallow | */compare-powerbank/ |
Disallow | */fitnessband/ |
Disallow | */mobile-phones |
Disallow | */tablets/ |
Disallow | */tech/compare-television/ |
Disallow | */tech/compare-laptops/ |
Disallow | */tech/compare-refrigerator/ |
Disallow | */tech/compare-washingmachine/ |
Disallow | */tech/compare-cameras/ |
Disallow | */tech/compare-powerbank/ |
Disallow | */compare-fitnessband/ |
Disallow | */compare-mobile-phones/ |
Disallow | */compare-tablets/ |
Disallow | */compare-smartwatch/ |
Disallow | */tech/compare-fitnessband/ |
Disallow | */tech/compare-mobile-phones/ |
Disallow | */tech/compare-tablets/ |
Disallow | */tech/compare-smartwatch/ |
Disallow | */tech/compare-ac/ |
Other Records
Field | Value |
---|---|
sitemap | https://navbharattimes.indiatimes.com/sitemap/today |
sitemap | https://navbharattimes.indiatimes.com/sitemap/yesterday |
sitemap | https://navbharattimes.indiatimes.com/staticsitemap/nbt/sitemap-index.xml |
sitemap | https://navbharattimes.indiatimes.com/staticsitemap/nbtvideo/sitemap-index.xml |
sitemap | https://navbharattimes.indiatimes.com/sitemapxml.cms |
sitemap | https://navbharattimes.indiatimes.com/navbharatgold/sitemap/24hours |