flarial.xyz
robots.txt

Robots Exclusion Standard data for flarial.xyz

Resource Scan

Scan Details

Site Domain flarial.xyz
Base Domain flarial.xyz
Scan Status Ok
Last Scan2025-11-19T19:32:41+00:00
Next Scan 2025-11-26T19:32:41+00:00

Last Scan

Scanned2025-11-19T19:32:41+00:00
URL https://flarial.xyz/robots.txt
Domain IPs 104.21.94.2, 172.67.217.100, 2606:4700:3034::6815:5e02, 2606:4700:3037::ac43:d964
Response IP 172.67.217.100
Found Yes
Hash 9d76181426e078ca7538cf1e0aeb02829105885d603e86fd616e1b7541335397
SimHash 69144a10d5e0

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /admin/

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://flarial.xyz/sitemap.xml

Comments

  • Sitemaps
  • Block access to admin and API routes if they exist
  • Allow Google and other search engines to crawl all public content