Log In Sign Up

boardeffect.com
robots.txt

Robots Exclusion Standard data for boardeffect.com

Resource Scan

Scan Details

Site Domain boardeffect.com
Base Domain boardeffect.com
Scan Status Ok
Last Scan2025-11-24T15:16:06+00:00
Next Scan 2025-12-24T15:16:06+00:00

Last Scan

Scanned2025-11-24T15:16:06+00:00
URL https://boardeffect.com/robots.txt
Redirect https://www.boardeffect.com/robots.txt
Redirect Domain www.boardeffect.com
Redirect Base boardeffect.com
Domain IPs 15.197.167.90, 3.33.186.135
Redirect IPs 15.197.167.90, 2406:da18:b3d:e201::1f5, 3.33.186.135
Response IP 3.33.186.135
Found Yes
Hash 199424c0f48bb48c498563fb439e1fa42bae29dc4cc096964c76d49242c66f1e
SimHash 012c4e10c7c3

Groups

*

Rule Path
Disallow /_next/
Disallow /static/
Disallow /server/
Disallow /private/
Disallow /api/
Disallow /admin/
Disallow /dashboard/
Disallow /internal/
Disallow /drafts/
Disallow /test/
Allow /
Back to top

Other Records

Field Value
sitemap https://www.boardeffect.com/sitemap.xml
Back to top

Comments

  • robots.txt for BoardEffect Next.js Website
  • Allow all search engines to crawl the main site
  • Block Next.js build and runtime files
  • Block API endpoints
  • Block sensitive or non-public folders
  • Allow everything else
  • Crawl-delay for aggressive bots
  • Crawl-delay: 10
  • Sitemap location
Back to top