tamil.hindustantimes.com
robots.txt

Robots Exclusion Standard data for tamil.hindustantimes.com

Resource Scan

Scan Details

Site Domain tamil.hindustantimes.com
Base Domain hindustantimes.com
Scan Status Ok
Last Scan2024-05-17T23:37:44+00:00
Next Scan 2024-06-16T23:37:44+00:00

Last Scan

Scanned2024-05-17T23:37:44+00:00
URL https://tamil.hindustantimes.com/robots.txt
Domain IPs 13.33.88.118, 13.33.88.12, 13.33.88.125, 13.33.88.40, 2600:9000:223b:4800:1d:2558:6140:93a1, 2600:9000:223b:a00:1d:2558:6140:93a1, 2600:9000:223b:c600:1d:2558:6140:93a1, 2600:9000:223b:d000:1d:2558:6140:93a1, 2600:9000:223b:d200:1d:2558:6140:93a1, 2600:9000:223b:e800:1d:2558:6140:93a1, 2600:9000:223b:f800:1d:2558:6140:93a1, 2600:9000:223b:fe00:1d:2558:6140:93a1
Response IP 13.33.88.118
Found Yes
Hash 173811839f5b16cf0840b8e1b038a69348631f64091a09135d66f13c24958e17
SimHash 4140c8430733

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://tamil.hindustantimes.com/sitemap.xml
sitemap https://tamil.hindustantimes.com/sitemap/all.xml
sitemap https://tamil.hindustantimes.com/sitemap/news-sitemap.xml