epochai.org
robots.txt

Robots Exclusion Standard data for epochai.org

Resource Scan

Scan Details

Site Domain epochai.org
Base Domain epochai.org
Scan Status Ok
Last Scan2025-08-12T00:38:23+00:00
Next Scan 2025-08-26T00:38:23+00:00

Last Scan

Scanned2025-08-12T00:38:23+00:00
URL https://epochai.org/robots.txt
Redirect https://epoch.ai/robots.txt
Redirect Domain epoch.ai
Redirect Base epoch.ai
Domain IPs 199.36.158.100
Redirect IPs 199.36.158.100
Response IP 199.36.158.100
Found Yes
Hash 3826e7fc1d71bb16ea5dc54250a179741eb6ce3f4764daf1a5e12f8bb0517bc0
SimHash ad858600c09b

Groups

*

Rule Path
Allow /assets/images
Allow /assets/docs
Disallow /assets/
Disallow /inspect-viewer/
Disallow /frontiermath/benchmark-problems

Other Records

Field Value
sitemap https://epoch.ai/sitemap.xml

Comments

  • Prevent crawling of sample benchmark problems