fijilive.com
robots.txt

Robots Exclusion Standard data for fijilive.com

Resource Scan

Scan Details

Site Domain fijilive.com
Base Domain fijilive.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-16T00:22:59+00:00
Next Scan 2026-02-14T00:22:59+00:00

Last Successful Scan

Scanned2025-04-20T13:15:25+00:00
URL https://fijilive.com/robots.txt
Domain IPs 104.21.8.173, 172.67.157.201, 2606:4700:3034::ac43:9dc9, 2606:4700:3037::6815:8ad
Response IP 172.67.157.201
Found Yes
Hash f44b9857441ce0f230d0601e8fe7c609f2c0f46835e91bc593d42918e0a1a205
SimHash 49241b72a253

Groups

googlebot-news

Rule Path
Allow /

*

Rule Path
Disallow /*/comments-*
Disallow /*/print/
Disallow /*.swf
Disallow /printpage/
Disallow /search?q=*

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

Other Records

Field Value
sitemap https://fijilive.com/sitemap_index.xml
sitemap https://fijilive.com/news-sitemap.xml

Comments

  • Agent Specific Disallowed Sections