malayalam.indiatoday.in
robots.txt

Robots Exclusion Standard data for malayalam.indiatoday.in

Resource Scan

Scan Details

Site Domain malayalam.indiatoday.in
Base Domain indiatoday.in
Scan Status Ok
Last Scan2025-11-07T20:48:58+00:00
Next Scan 2025-11-14T20:48:58+00:00

Last Scan

Scanned2025-11-07T20:48:58+00:00
URL https://malayalam.indiatoday.in/robots.txt
Domain IPs 23.58.144.194, 23.58.144.196, 2600:1413:5000:3::1736:768c, 2600:1413:5000:3::1736:768e
Response IP 96.17.72.57
Found Yes
Hash b68daecd3593fc9caf78386429edf0e96307823b2fe2b626501273c13fdf9edc
SimHash 08089c260db1

Groups

*

Rule Path
Allow /
Disallow /topic/*
Disallow /ajax/right-latest-news
Disallow /ajax/author-newslist?*
Disallow /ajax/right-election-latest-news

Other Records

Field Value
sitemap https://malayalam.indiatoday.in/rssfeeds/news-sitemap.xml