Log In Sign Up

sunstar.com.ph
robots.txt

Robots Exclusion Standard data for sunstar.com.ph

Resource Scan

Scan Details

Site Domain sunstar.com.ph
Base Domain sunstar.com.ph
Scan Status Ok
Last Scan2024-09-21T06:54:05+00:00
Next Scan 2024-09-28T06:54:05+00:00

Last Scan

Scanned2024-09-21T06:54:05+00:00
URL https://sunstar.com.ph/robots.txt
Redirect https://www.sunstar.com.ph/robots.txt
Redirect Domain www.sunstar.com.ph
Redirect Base sunstar.com.ph
Domain IPs 23.20.179.164, 54.158.195.16
Redirect IPs 104.18.90.198, 104.18.91.198, 104.18.92.198, 104.18.93.198, 104.18.94.198, 2606:4700::6812:5ac6, 2606:4700::6812:5bc6, 2606:4700::6812:5cc6, 2606:4700::6812:5dc6, 2606:4700::6812:5ec6
Response IP 104.18.92.198
Found Yes
Hash 18433431db4e9d262edc888131acc99ce27edb173cb7c60a691669fb9438385e
SimHash 61101960af13

Groups

*
grapeshot

Rule Path
Allow /

gptbot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.sunstar.com.ph/sitemap.xml
sitemap https://www.sunstar.com.ph/news_sitemap.xml
Back to top