Log In Sign Up

dragatron.com.au
robots.txt

Robots Exclusion Standard data for dragatron.com.au

Resource Scan

Scan Details

Site Domain dragatron.com.au
Base Domain dragatron.com.au
Scan Status Ok
Last Scan2025-09-23T00:27:36+00:00
Next Scan 2025-10-23T00:27:36+00:00

Last Scan

Scanned2025-09-23T00:27:36+00:00
URL https://dragatron.com.au/robots.txt
Redirect https://www.dragatron.com.au/robots.txt
Redirect Domain www.dragatron.com.au
Redirect Base dragatron.com.au
Domain IPs 3.165.75.107, 3.165.75.108, 3.165.75.129, 3.165.75.40
Redirect IPs 2600:9000:271a:3600:3:997e:4240:93a1, 2600:9000:271a:4800:3:997e:4240:93a1, 2600:9000:271a:5600:3:997e:4240:93a1, 2600:9000:271a:6a00:3:997e:4240:93a1, 2600:9000:271a:7000:3:997e:4240:93a1, 2600:9000:271a:800:3:997e:4240:93a1, 2600:9000:271a:9a00:3:997e:4240:93a1, 2600:9000:271a:a800:3:997e:4240:93a1, 3.165.75.107, 3.165.75.108, 3.165.75.129, 3.165.75.40
Response IP 3.165.75.40
Found Yes
Hash 2b406fe3cfc34315dbc1fcb0cbe1a6c46400c88ac4d8aeb496e8a82eff7b3184
SimHash 2c885e722427

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /api/
Disallow /_next/
Disallow /static/
Allow /
Allow /features
Allow /solutions
Allow /mobile-apps
Allow /pricing
Allow /resources
Allow /contact
Allow /privacy
Allow /terms

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://dragatron.com.au/sitemap.xml
Back to top

Comments

  • Block crawling of admin areas and sensitive paths
  • Allow important pages
  • Sitemap location
  • Crawl delay (optional)
Back to top