mtmobile.in
robots.txt

Robots Exclusion Standard data for mtmobile.in

Resource Scan

Scan Details

Site Domain mtmobile.in
Base Domain mtmobile.in
Scan Status Ok
Last Scan2024-05-01T16:30:34+00:00
Next Scan 2024-05-31T16:30:34+00:00

Last Scan

Scanned2024-05-01T16:30:34+00:00
URL http://mtmobile.in/robots.txt
Redirect https://m.maharashtratimes.com/robots.txt
Redirect Domain m.maharashtratimes.com
Redirect Base maharashtratimes.com
Domain IPs 103.238.101.145
Redirect IPs 118.215.80.183, 2600:1413:1:996::3126
Response IP 104.69.163.188
Found Yes
Hash 0b8897cce24ca8812703ad00b5e5a31f95bd97c9c69644800109744c23e0c955
SimHash 35580961a693

Groups

*

Rule Path
Allow /
Allow /aapla-bajar/
Disallow /?back=1
Disallow */xml/
Disallow /7176/
Disallow */topics/
Disallow */topic/
Disallow */videoplayer
Disallow */tech/mobile-phones/
Disallow */tech/tablets/
Disallow */tech/smartwatch/
Disallow */tech/ac/
Disallow */tech/television/
Disallow */tech/laptops/
Disallow */tech/refrigerator/
Disallow */tech/washingmachine/
Disallow */tech/cameras/
Disallow */smartwatch/
Disallow */ac/
Disallow */television/
Disallow */laptops/
Disallow */refrigerator/
Disallow */washingmachine/
Disallow */cameras/
Disallow */powerbank/
Disallow */tech/powerbank/
Disallow */tech/fitnessband/
Disallow */compare-ac/
Disallow */compare-television/
Disallow */compare-laptops/
Disallow */compare-refrigerator/
Disallow */compare-washingmachine/
Disallow */compare-cameras/
Disallow */compare-powerbank/
Disallow */fitnessband/
Disallow */tablets/
Disallow */tech/compare-television/
Disallow */tech/compare-laptops/
Disallow */tech/compare-refrigerator/
Disallow */tech/compare-washingmachine/
Disallow */tech/compare-cameras/
Disallow */tech/compare-powerbank/
Disallow */compare-fitnessband/
Disallow */compare-mobile-phones/
Disallow */compare-tablets/
Disallow */compare-smartwatch/
Disallow */tech/compare-fitnessband/
Disallow */tech/compare-mobile-phones/
Disallow */tech/compare-tablets/
Disallow */tech/compare-smartwatch/
Disallow */tech/compare-ac/

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://marathi.indiatimes.com/sitemap/today
sitemap https://marathi.indiatimes.com/sitemap/yesterday
sitemap https://marathi.indiatimes.com/sitemapxml.cms
sitemap https://marathi.indiatimes.com/staticsitemap/mt/sitemap-index.xml
sitemap https://marathi.indiatimes.com/amp_stories/amp_web_stories_sitemap.cms
sitemap https://marathi.indiatimes.com/langapi/sitemap/topics-sitemap/106204687.xml
sitemap https://marathi.indiatimes.com/elections/static_content/constituencyloksabha_mt.xml