bibi.academy
robots.txt

Robots Exclusion Standard data for bibi.academy

Resource Scan

Scan Details

Site Domain bibi.academy
Base Domain bibi.academy
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-20T11:06:18+00:00
Next Scan 2026-01-03T11:06:18+00:00

Last Successful Scan

Scanned2025-10-21T23:51:29+00:00
URL https://bibi.academy/robots.txt
Domain IPs 104.26.14.47, 104.26.15.47, 172.67.72.229, 2606:4700:20::681a:e2f, 2606:4700:20::681a:f2f, 2606:4700:20::ac43:48e5
Response IP 172.67.72.229
Found Yes
Hash f2ad9f491974a8b8b4ab9cc1b1a5ba8dcf14524d3577ffa16c6468e382adcba3
SimHash 28854d506880

Groups

*

Rule Path
Disallow /circle/
Disallow /wp-json/
Disallow /wp-admin/
Disallow /wp-content/uploads/
Disallow /cdn-cgi/bm/cv/
Disallow /cdn-cgi/challenge-platform/

Other Records

Field Value
sitemap https://www.bibi.academy/sitemap_index.xml

Comments

  • Global rules
  • -----------------
  • Prevent crawling CF challenge URLs
  • Sitemap
  • -----------------