Log In Sign Up

cobhamaviation.com.au
robots.txt

Robots Exclusion Standard data for cobhamaviation.com.au

Resource Scan

Scan Details

Site Domain cobhamaviation.com.au
Base Domain cobhamaviation.com.au
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-01-26T08:21:17+00:00
Next Scan 2026-04-26T08:21:17+00:00

Last Successful Scan

Scanned2023-10-08T15:48:11+00:00
URL https://cobhamaviation.com.au/robots.txt
Redirect https://www.cobhamaviation.com.au/robots.txt
Redirect Domain www.cobhamaviation.com.au
Redirect Base cobhamaviation.com.au
Domain IPs 108.61.213.27
Redirect IPs 108.61.213.27
Response IP 108.61.213.27
Found Yes
Hash 8180c1b86e6c257fdbb75f1e2db7efa81b3de2e73973906cc88c0a175414d2b2
SimHash 413a1d567f93

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Back to top

Other Records

Field Value
sitemap https://www.cobhamaviation.com.au/sitemaps-1-sitemap.xml
Back to top

Comments

  • robots.txt for https://www.cobhamaviation.com.au/
  • live - don't allow web crawlers to index cpresources/ or vendor/
Back to top