toi.timesofindia.indiatimes.com
robots.txt

Robots Exclusion Standard data for toi.timesofindia.indiatimes.com

Resource Scan

Scan Details

Site Domain toi.timesofindia.indiatimes.com
Base Domain indiatimes.com
Scan Status Ok
Last Scan2025-04-25T14:12:12+00:00
Next Scan 2025-05-25T14:12:12+00:00

Last Scan

Scanned2025-04-25T14:12:12+00:00
URL http://toi.timesofindia.indiatimes.com/robots.txt
Domain IPs 23.49.60.95, 23.49.60.98, 2600:1413:5000:2b::173a:90a5, 2600:1413:5000:2b::173a:90ad
Response IP 42.99.140.200
Found Yes
Hash 54fbff92fc9e4ebda507fa17283575dafde626d030d3aa483b619b5eff0e6bb4
SimHash 105dd8048bd3

Groups

*

Rule Path
Disallow /
Disallow /life-style/food/food-reviews/On-a-blind-foodie-date/articleshow/6287320.cms
Disallow /life-style/food/food-reviews/Kya-Mukkamo-Khush-Hua/articleshow/9968144.cms
Disallow /life-style/food/food-reviews/Eaten-of-the-track/articleshow/7216331.cms?referral=PM
Disallow /life-style/food/food-reviews/kya-mukkamo-khush-hua/articleshow/9968144.cms
Disallow /life-style/food/food-reviews/eaten-of-the-track/articleshow/7216331.cms
Disallow /life-style/food/food-reviews/Eaten-of-the-track/articleshow/7216331.cms