Log In Sign Up

surveydesign.com.au
robots.txt

Robots Exclusion Standard data for surveydesign.com.au

Resource Scan

Scan Details

Site Domain surveydesign.com.au
Base Domain surveydesign.com.au
Scan Status Ok
Last Scan2026-01-07T16:30:54+00:00
Next Scan 2026-02-06T16:30:54+00:00

Last Scan

Scanned2026-01-07T16:30:54+00:00
URL https://surveydesign.com.au/robots.txt
Domain IPs 198.38.93.18
Response IP 198.38.93.18
Found Yes
Hash 58831d3fbaf0aaecd23f61311bfbbfa7335c01ec0918b1f5680bd40eb3b83ab5
SimHash 89819341cfb3

Groups

builtwith

Rule Path
Disallow /

*

Rule Path
Allow /css/
Allow /js/
Allow /nstyle/
Allow /nscript/
Allow /script/
Allow /nimages/
Allow /ninclude/
Allow /preview/
Disallow /cgi-bin/
Disallow /include/
Disallow /nphp/
Disallow /orders/
Disallow /clients/
Disallow /id/
Disallow /datasets/
Back to top

Other Records

Field Value
sitemap https://surveydesign.com.au/sitemap.xml
sitemap https://www.surveydesign.com.au/sitemap.xml
Back to top

Comments

  • Block BuiltWith only
  • Default rules for everyone else
  • Ensure render-critical assets stay crawlable
  • Keep private/system areas blocked
  • Everything else is allowed by default
  • Sitemaps for THIS host only
Back to top