hackatime.hackclub.com
robots.txt

Robots Exclusion Standard data for hackatime.hackclub.com

Resource Scan

Scan Details

Site Domain hackatime.hackclub.com
Base Domain hackclub.com
Scan Status Ok
Last Scan2025-08-21T02:12:54+00:00
Next Scan 2025-09-20T02:12:54+00:00

Last Scan

Scanned2025-08-21T02:12:54+00:00
URL https://hackatime.hackclub.com/robots.txt
Domain IPs 5.161.205.27
Response IP 5.161.205.27
Found Yes
Hash d4c334941c2599cac6c71891e13f15ea08b560467a89fb25a7be601d9f4000e6
SimHash 284c2b96c633

Groups

*

Rule Path
Allow /
Allow /docs
Allow /docs/*
Allow /leaderboard
Disallow /my/
Disallow /admin/
Disallow /api/
Disallow /auth/

Other Records

Field Value
sitemap https://hackatime.hackclub.com/sitemap.xml

Comments

  • Important pages for crawling
  • Disallow private/internal pages
  • Sitemap