applyengine.ai
robots.txt

Robots Exclusion Standard data for applyengine.ai

Resource Scan

Scan Details

Site Domain applyengine.ai
Base Domain applyengine.ai
Scan Status Ok
Last Scan2026-03-11T04:36:16+00:00
Next Scan 2026-04-10T04:36:16+00:00

Last Scan

Scanned2026-03-11T04:36:16+00:00
URL https://applyengine.ai/robots.txt
Domain IPs 104.26.12.37, 104.26.13.37, 172.67.71.99, 2606:4700:20::681a:c25, 2606:4700:20::681a:d25, 2606:4700:20::ac43:4763
Response IP 104.26.12.37
Found Yes
Hash 972a17a0d0a1ff102759c188282440264ec9d28a709fcae605072962926d747f
SimHash ac327b748c0f

Groups

*

Rule Path
Allow /
Allow /about
Allow /pricing
Allow /contact
Allow /privacy
Allow /terms
Allow /help
Allow /success-stories
Allow /resume-builder
Allow /linkedin-creator
Allow /auto-job-apply
Allow /content-creator
Allow /resume-feedback
Allow /review/
Allow /landing/resume
Allow /discussions
Allow /discussions/
Allow /discussions/directory
Allow /discussions/2025/
Allow /discussions/2024/
Disallow /dashboard
Disallow /account
Disallow /activities
Disallow /create-resume
Disallow /my-resumes
Disallow /ai-agents
Disallow /tools/
Disallow /linkedin-profile
Disallow /optimize-linkedin
Disallow /applications
Disallow /connections
Disallow /messages
Disallow /content-library
Disallow /schedules
Disallow /linkedin-posts
Disallow /job-search
Disallow /settings
Disallow /login
Disallow /signup
Disallow /static/

Other Records

Field Value
sitemap https://applyengine.ai/sitemap.xml

Comments

  • Important pages for crawling
  • Resume review - allow public features
  • Discussion board - allow crawling
  • Block admin/internal pages
  • Block auth pages
  • Block build artifacts
  • Sitemap location