epoch.ai
robots.txt

Robots Exclusion Standard data for epoch.ai

Resource Scan

Scan Details

Site Domain epoch.ai
Base Domain epoch.ai
Scan Status Ok
Last Scan2025-08-26T09:01:39+00:00
Next Scan 2025-09-09T09:01:39+00:00

Last Scan

Scanned2025-08-26T09:01:39+00:00
URL https://epoch.ai/robots.txt
Domain IPs 199.36.158.100
Response IP 199.36.158.100
Found Yes
Hash 3826e7fc1d71bb16ea5dc54250a179741eb6ce3f4764daf1a5e12f8bb0517bc0
SimHash ad858600c09b

Groups

*

Rule Path
Allow /assets/images
Allow /assets/docs
Disallow /assets/
Disallow /inspect-viewer/
Disallow /frontiermath/benchmark-problems

Other Records

Field Value
sitemap https://epoch.ai/sitemap.xml

Comments

  • Prevent crawling of sample benchmark problems