sportstarlive.com
robots.txt

Robots Exclusion Standard data for sportstarlive.com

Resource Scan

Scan Details

Site Domain sportstarlive.com
Base Domain sportstarlive.com
Scan Status Ok
Last Scan2024-11-02T14:17:43+00:00
Next Scan 2024-11-09T14:17:43+00:00

Last Scan

Scanned2024-11-02T14:17:43+00:00
URL https://sportstarlive.com/robots.txt
Redirect https://sportstar.thehindu.com/robots.txt
Redirect Domain sportstar.thehindu.com
Redirect Base thehindu.com
Domain IPs 104.18.115.237, 104.18.116.237, 2606:4700::6812:73ed, 2606:4700::6812:74ed
Redirect IPs 104.18.39.235, 172.64.148.21, 2606:4700:4400::6812:27eb, 2606:4700:4400::ac40:9415
Response IP 104.18.39.235
Found Yes
Hash 6bcd81f0ffdfcca5a550a5c592db3cd5818b881c4998ad5759978045b701d1db
SimHash 6915fa608313

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /nic/
Disallow /config/*
Disallow /search/*
Disallow /cdn-cgi/*
Disallow */analysis-logger/*
Disallow /static/
Allow /static/content/ss/flipbook/
Disallow */theme/images/ss-online/matchcenter/flags/*
Disallow /theme/images/ss-online/matchcenter/players/

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://sportstar.thehindu.com/sitemap/googlenews.xml
sitemap https://sportstar.thehindu.com/sitemap/update.xml
sitemap https://sportstar.thehindu.com/sitemap/archive.xml

Comments

  • Disallow ChatGPT from extracting or interpreting our content