tech.hindustantimes.com
robots.txt

Robots Exclusion Standard data for tech.hindustantimes.com

Resource Scan

Scan Details

Site Domain tech.hindustantimes.com
Base Domain hindustantimes.com
Scan Status Ok
Last Scan2024-05-06T13:19:18+00:00
Next Scan 2024-05-20T13:19:18+00:00

Last Scan

Scanned2024-05-06T13:19:18+00:00
URL https://tech.hindustantimes.com/robots.txt
Domain IPs 108.157.254.124, 108.157.254.18, 108.157.254.78, 108.157.254.91, 2600:9000:2753:3e00:1e:5bdd:3740:93a1, 2600:9000:2753:4a00:1e:5bdd:3740:93a1, 2600:9000:2753:8400:1e:5bdd:3740:93a1, 2600:9000:2753:a800:1e:5bdd:3740:93a1, 2600:9000:2753:b600:1e:5bdd:3740:93a1, 2600:9000:2753:be00:1e:5bdd:3740:93a1, 2600:9000:2753:ea00:1e:5bdd:3740:93a1, 2600:9000:2753:f800:1e:5bdd:3740:93a1
Response IP 108.157.254.91
Found Yes
Hash 96ad7c37c7a104096cdfbf08848c2392d6d748b4f45e938c19a0e3d7024950dc
SimHash 79049a01e213

Groups

*

Rule Path
Allow /
Disallow /search?*

Other Records

Field Value
sitemap https://tech.hindustantimes.com/sitemap-index.xml
sitemap https://tech.hindustantimes.com/news-sitemap.xml
sitemap https://tech.hindustantimes.com/section-sitemap.xml
sitemap https://tech.hindustantimes.com/photos.xml
sitemap https://tech.hindustantimes.com/sitemap-laptops-product.xml
sitemap https://tech.hindustantimes.com/sitemap-mobiles-product.xml
sitemap https://tech.hindustantimes.com/sitemap-tablets-product.xml