eclipseproxy.com
robots.txt

Robots Exclusion Standard data for eclipseproxy.com

Resource Scan

Scan Details

Site Domain eclipseproxy.com
Base Domain eclipseproxy.com
Scan Status Ok
Last Scan2025-10-23T09:37:28+00:00
Next Scan 2025-11-22T09:37:28+00:00

Last Scan

Scanned2025-10-23T09:37:28+00:00
URL https://eclipseproxy.com/robots.txt
Redirect https://www.eclipseproxy.com/robots.txt
Redirect Domain www.eclipseproxy.com
Redirect Base eclipseproxy.com
Domain IPs 104.21.16.237, 172.67.216.218, 2606:4700:3033::6815:10ed, 2606:4700:3037::ac43:d8da
Redirect IPs 104.21.16.237, 172.67.216.218, 2606:4700:3033::6815:10ed, 2606:4700:3037::ac43:d8da
Response IP 172.67.216.218
Found Yes
Hash a1c1db58dd538198607b364654db9c9bacc59aa151157a427b7d5f70cb792944
SimHash 2f9892c2a463

Groups

*

Rule Path
Allow /
Allow /
Allow /pricing
Allow /ai
Allow /enterprise
Allow /login
Allow /register
Allow /privacy
Allow /terms
Allow /transparency
Allow /pools
Allow /api/
Disallow /dashboard/
Disallow /admin/
Disallow /api/auth/
Disallow /api/user/
Disallow /api/reset*/
Disallow /api/whitelist/
Disallow /_next/
Disallow /node_modules/
Disallow /*.json$
Disallow /*.log$
Disallow /tmp/
Disallow /temp/
Allow /favicon.ico
Allow /logo*.png
Allow /image.png
Allow /*.css
Allow /*.js
Allow /fonts/
Allow /images/
Allow /public/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://eclipseproxy.com/sitemap.xml

Comments

  • Main pages
  • API endpoints - allow for legitimate use
  • Block sensitive areas
  • Block temporary and development files
  • Allow important resources
  • Crawl delay to be respectful
  • Sitemap location