punjabi.hindustantimes.com
robots.txt

Robots Exclusion Standard data for punjabi.hindustantimes.com

Resource Scan

Scan Details

Site Domain punjabi.hindustantimes.com
Base Domain hindustantimes.com
Scan Status Ok
Last Scan2024-05-12T13:37:01+00:00
Next Scan 2024-06-11T13:37:01+00:00

Last Scan

Scanned2024-05-12T13:37:01+00:00
URL https://punjabi.hindustantimes.com/robots.txt
Domain IPs 23.76.97.199, 2600:1417:3f:b96::1833, 2600:1417:3f:bb2::1833
Response IP 23.195.153.239
Found Yes
Hash 13156450b8b1d05ab3f4a62e50150998c518c3538c1b62d08424d7532fa17419
SimHash c801d800ab82

Groups

*

Rule Path
Disallow
Disallow /tags/*/false/
Disallow /nandan/
Disallow /anokhi/

Other Records

Field Value
sitemap https://punjabi.hindustantimes.com/category-sitemap.xml
sitemap https://punjabi.hindustantimes.com/news-sitemap.xml