Log In Sign Up

9tech.dev
robots.txt

Robots Exclusion Standard data for 9tech.dev

Resource Scan

Scan Details

Site Domain 9tech.dev
Base Domain 9tech.dev
Scan Status Ok
Last Scan2025-04-20T05:04:54+00:00
Next Scan 2025-04-27T05:04:54+00:00

Last Scan

Scanned2025-04-20T05:04:54+00:00
URL https://9tech.dev/robots.txt
Domain IPs 104.21.86.195, 172.67.136.88, 2606:4700:3034::6815:56c3, 2606:4700:3037::ac43:8858
Response IP 104.21.86.195
Found Yes
Hash c5e3fc4927d560d9bdf93893b5a67c264792997496b9b472e0802759c39fde69
SimHash 414986d14791

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Allow *.css
Allow *.js
Allow /_next/static/css/*.css
Allow /_next/static/chunks/*.js

googlebot-mobile

Rule Path
Allow *.css
Allow *.js
Allow /_next/static/css/*.css
Allow /_next/static/chunks/*.js
Back to top

Other Records

Field Value
sitemap https://9tech.dev/sitemap.xml
Back to top

Comments

  • *
  • Host
  • Sitemaps
  • Googlebot
Back to top

Warnings

  • `host` is not a known field.
Back to top