thehansindia.com
robots.txt
Robots Exclusion Standard data for thehansindia.com
Resource Scan
Scan Details
| Site Domain | thehansindia.com |
| Base Domain | thehansindia.com |
| Scan Status | Ok |
| Last Scan | 2024-09-15T01:48:48+00:00 |
| Next Scan | 2024-09-22T01:48:48+00:00 |
Last Scan
| Scanned | 2024-09-15T01:48:48+00:00 |
| URL | https://thehansindia.com/robots.txt |
| Redirect | https://www.thehansindia.com/robots.txt |
| Redirect Domain | www.thehansindia.com |
| Redirect Base | thehansindia.com |
| Domain IPs | 104.21.18.244, 172.67.183.243, 2606:4700:3032::6815:12f4, 2606:4700:3035::ac43:b7f3 |
| Redirect IPs | 104.21.18.244, 172.67.183.243, 2606:4700:3032::6815:12f4, 2606:4700:3035::ac43:b7f3 |
| Response IP | 172.67.183.243 |
| Found | Yes |
| Hash | c3ca6ed8d301dd5e410180dfad919f78208e72bb0da99dd62e13d74dbbf84905 |
| SimHash | 88401e53add7 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /admin/* |
| Disallow | /partnercontent/* |
| Disallow | /xhr/* |
| Disallow | /app-lite/* |
| Disallow | /refer-* |
| Disallow | /search/* |
| Disallow | /search?* |
| Disallow | /xhr/* |
| Disallow | /preview/story-* |
| Disallow | /amp/preview/story-* |
| Disallow | /staging/* |
| Allow | /xhr/getNewsMixin* |
| Allow | /content/servlet/RDESController?* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.thehansindia.com/sitemap/sitemap-index.xml |
| sitemap | https://www.thehansindia.com/news-sitemap-daily.xml |
| sitemap | https://www.thehansindia.com/sitemap-daily.xml |
Comments