Log In Sign Up

koder3.com
robots.txt

Robots Exclusion Standard data for koder3.com

Resource Scan

Scan Details

Site Domain koder3.com
Base Domain koder3.com
Scan Status Ok
Last Scan2026-01-20T20:39:19+00:00
Next Scan 2026-02-19T20:39:19+00:00

Last Scan

Scanned2026-01-20T20:39:19+00:00
URL https://koder3.com/robots.txt
Domain IPs 104.21.30.10, 172.67.150.46, 2606:4700:3032::ac43:962e, 2606:4700:3036::6815:1e0a
Response IP 172.67.150.46
Found Yes
Hash 9512ad75b755229688c69f81a9f2c3a22b55e2e029ad2106831d2021efc3c119
SimHash 0d495933e124

Groups

*

Rule Path
Allow /
Allow /about
Allow /services/
Allow /k-products/
Allow /portfolio
Allow /customers
Allow /career
Allow /contact
Allow /images/
Allow /icons/
Allow /favicon.ico
Allow /_next/static/
Disallow /admin/
Disallow /_next/
Disallow /api/
Disallow /.well-known/
Disallow /test/
Disallow /tests/
Disallow /dev/
Disallow /*.json$
Disallow /*.log$

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://koder3.com/sitemap.xml
Back to top

Comments

  • robots.txt for Koder3 Website
  • https://koder3.com
  • Allow all main sections
  • Allow static assets
  • Disallow admin and internal paths
  • Disallow development and testing files
  • Special handling for different bot types
  • Sitemap location
  • Crawl-delay for non-major search engines
Back to top