Log In Sign Up

natively.dev
robots.txt

Robots Exclusion Standard data for natively.dev

Resource Scan

Scan Details

Site Domain natively.dev
Base Domain natively.dev
Scan Status Ok
Last Scan2025-07-21T00:10:46+00:00
Next Scan 2025-08-20T00:10:46+00:00

Last Scan

Scanned2025-07-21T00:10:46+00:00
URL https://natively.dev/robots.txt
Domain IPs 216.150.1.193
Response IP 216.150.1.193
Found Yes
Hash 73fe63174b2375f91a90d6da0339e0ebcff697b659721c167027993e36163372
SimHash af80d8a26ca3

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /api/
Disallow /_next/
Disallow /app-admin/
Disallow /pricing/
Allow /
Allow /about
Allow /blog
Allow /blog/*
Allow /examples
Allow /project/*
Allow /privacy-policy
Allow /terms

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://natively.dev/sitemap.xml
Back to top

Comments

  • Block admin and API routes
  • Block dashboard routes (user-specific content)
  • Allow important marketing pages
  • Sitemap location
  • Crawl delay for better server performance
Back to top