Log In Sign Up

asfar.io
robots.txt

Robots Exclusion Standard data for asfar.io

Resource Scan

Scan Details

Site Domain asfar.io
Base Domain asfar.io
Scan Status Ok
Last Scan2025-12-06T16:28:13+00:00
Next Scan 2026-01-05T16:28:13+00:00

Last Scan

Scanned2025-12-06T16:28:13+00:00
URL https://asfar.io/robots.txt
Domain IPs 104.26.4.227, 104.26.5.227, 172.67.71.89, 2606:4700:20::681a:4e3, 2606:4700:20::681a:5e3, 2606:4700:20::ac43:4759
Response IP 172.67.71.89
Found Yes
Hash 21ad24a0f88ee7d8adff262301f5a67e9662181669256bcf7511126fd6ed2e08
SimHash 60201b02a158

Groups

*

Rule Path
Disallow /cdn-cgi/
Back to top

Comments

  • Block Cloudflare cdn-cgi endpoints to resolve analytics and JavaScript issues
  • This prevents crawlers from accessing broken RUM endpoints
  • Should resolve issues within 48 hours according to Cloudflare documentation
Back to top