toiimages.timesofindia.indiatimes.com
robots.txt
Robots Exclusion Standard data for toiimages.timesofindia.indiatimes.com
Resource Scan
Scan Details
Site Domain | toiimages.timesofindia.indiatimes.com |
Base Domain | indiatimes.com |
Scan Status | Ok |
Last Scan | 2024-05-30T15:53:53+00:00 |
Next Scan | 2024-06-29T15:53:53+00:00 |
Last Scan
Scanned | 2024-05-30T15:53:53+00:00 |
URL | http://toiimages.timesofindia.indiatimes.com/robots.txt |
Domain IPs | 23.49.60.103, 23.49.60.104, 2600:1413:1::1734:ab93, 2600:1413:1::1734:ab99 |
Response IP | 125.56.219.35 |
Found | Yes |
Hash | 54fbff92fc9e4ebda507fa17283575dafde626d030d3aa483b619b5eff0e6bb4 |
SimHash | 105dd8048bd3 |
Groups
*
Rule | Path |
---|---|
Disallow | / |
Disallow | /life-style/food/food-reviews/On-a-blind-foodie-date/articleshow/6287320.cms |
Disallow | /life-style/food/food-reviews/Kya-Mukkamo-Khush-Hua/articleshow/9968144.cms |
Disallow | /life-style/food/food-reviews/Eaten-of-the-track/articleshow/7216331.cms?referral=PM |
Disallow | /life-style/food/food-reviews/kya-mukkamo-khush-hua/articleshow/9968144.cms |
Disallow | /life-style/food/food-reviews/eaten-of-the-track/articleshow/7216331.cms |
Disallow | /life-style/food/food-reviews/Eaten-of-the-track/articleshow/7216331.cms |