mytimes.indiatimes.com
robots.txt
Robots Exclusion Standard data for mytimes.indiatimes.com
Resource Scan
Scan Details
Site Domain | mytimes.indiatimes.com |
Base Domain | indiatimes.com |
Scan Status | Ok |
Last Scan | 2024-05-13T04:46:55+00:00 |
Next Scan | 2024-05-27T04:46:55+00:00 |
Last Scan
Scanned | 2024-05-13T04:46:55+00:00 |
URL | https://mytimes.indiatimes.com/robots.txt |
Domain IPs | 23.210.101.63, 2600:1413:b000:285::143a, 2600:1413:b000:293::143a |
Response IP | 23.15.99.91 |
Found | Yes |
Hash | a5bff620ce909e9253fb7bca289484bc6d7310b0409307c7abf662abee5c0924 |
SimHash | 504042404756 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /*rssarticleshow* |
Disallow | /*prtpage* |
Disallow | /opinions/ |