15.dev
robots.txt

Robots Exclusion Standard data for 15.dev

Resource Scan

Scan Details

Site Domain 15.dev
Base Domain 15.dev
Scan Status Ok
Last Scan2025-09-21T18:01:42+00:00
Next Scan 2025-10-21T18:01:42+00:00

Last Scan

Scanned2025-09-21T18:01:42+00:00
URL https://15.dev/robots.txt
Domain IPs 104.21.68.155, 172.67.196.166, 2606:4700:3031::ac43:c4a6, 2606:4700:3036::6815:449b
Response IP 104.21.68.155
Found Yes
Hash 645c948ac3124a0694f0d8803663e33b89576e9c6b28e09e3f178e0350ae7973
SimHash 4188de53cf31

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /api/
Disallow /your/admin-refresh/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://15.dev/sitemap.xml

Comments

  • Disallow admin areas
  • Sitemap location
  • Crawl-delay directive for better server performance