toi.timesofindia.indiatimes.com
robots.txt
Robots Exclusion Standard data for toi.timesofindia.indiatimes.com
Resource Scan
Scan Details
Site Domain | toi.timesofindia.indiatimes.com |
Base Domain | indiatimes.com |
Scan Status | Ok |
Last Scan | 2025-04-25T14:12:12+00:00 |
Next Scan | 2025-05-25T14:12:12+00:00 |
Last Scan
Scanned | 2025-04-25T14:12:12+00:00 |
URL | http://toi.timesofindia.indiatimes.com/robots.txt |
Domain IPs | 23.49.60.95, 23.49.60.98, 2600:1413:5000:2b::173a:90a5, 2600:1413:5000:2b::173a:90ad |
Response IP | 42.99.140.200 |
Found | Yes |
Hash | 54fbff92fc9e4ebda507fa17283575dafde626d030d3aa483b619b5eff0e6bb4 |
SimHash | 105dd8048bd3 |
Groups
*
Rule | Path |
---|---|
Disallow | / |
Disallow | /life-style/food/food-reviews/On-a-blind-foodie-date/articleshow/6287320.cms |
Disallow | /life-style/food/food-reviews/Kya-Mukkamo-Khush-Hua/articleshow/9968144.cms |
Disallow | /life-style/food/food-reviews/Eaten-of-the-track/articleshow/7216331.cms?referral=PM |
Disallow | /life-style/food/food-reviews/kya-mukkamo-khush-hua/articleshow/9968144.cms |
Disallow | /life-style/food/food-reviews/eaten-of-the-track/articleshow/7216331.cms |
Disallow | /life-style/food/food-reviews/Eaten-of-the-track/articleshow/7216331.cms |