sportstar.thehindu.com
robots.txt
Robots Exclusion Standard data for sportstar.thehindu.com
Resource Scan
Scan Details
Site Domain | sportstar.thehindu.com |
Base Domain | thehindu.com |
Scan Status | Ok |
Last Scan | 2024-11-08T03:56:13+00:00 |
Next Scan | 2024-11-22T03:56:13+00:00 |
Last Scan
Scanned | 2024-11-08T03:56:13+00:00 |
URL | https://sportstar.thehindu.com/robots.txt |
Domain IPs | 104.18.39.235, 172.64.148.21, 2606:4700:4400::6812:27eb, 2606:4700:4400::ac40:9415 |
Response IP | 172.64.148.21 |
Found | Yes |
Hash | 6bcd81f0ffdfcca5a550a5c592db3cd5818b881c4998ad5759978045b701d1db |
SimHash | 6915fa608313 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /nic/ |
Disallow | /config/* |
Disallow | /search/* |
Disallow | /cdn-cgi/* |
Disallow | */analysis-logger/* |
Disallow | /static/ |
Allow | /static/content/ss/flipbook/ |
Disallow | */theme/images/ss-online/matchcenter/flags/* |
Disallow | /theme/images/ss-online/matchcenter/players/ |
Other Records
Field | Value |
---|---|
sitemap | https://sportstar.thehindu.com/sitemap/googlenews.xml |
sitemap | https://sportstar.thehindu.com/sitemap/update.xml |
sitemap | https://sportstar.thehindu.com/sitemap/archive.xml |
Comments