engineeringstructures.com.au
robots.txt
Robots Exclusion Standard data for engineeringstructures.com.au
Resource Scan
Scan Details
| Site Domain | engineeringstructures.com.au |
| Base Domain | engineeringstructures.com.au |
| Scan Status | Ok |
| Last Scan | 2025-12-21T03:37:54+00:00 |
| Next Scan | 2025-12-28T03:37:54+00:00 |
Last Scan
| Scanned | 2025-12-21T03:37:54+00:00 |
| URL | https://engineeringstructures.com.au/robots.txt |
| Redirect | https://www.engineeringstructures.com.au/robots.txt |
| Redirect Domain | www.engineeringstructures.com.au |
| Redirect Base | engineeringstructures.com.au |
| Domain IPs | 104.21.26.155, 172.67.137.16, 2606:4700:3031::6815:1a9b, 2606:4700:3037::ac43:8910 |
| Redirect IPs | 104.21.26.155, 172.67.137.16, 2606:4700:3031::6815:1a9b, 2606:4700:3037::ac43:8910 |
| Response IP | 172.67.137.16 |
| Found | Yes |
| Hash | f75b5dc40069e7671f047c0c9da9c8a03b0560d693c329f56c43aac84849dcca |
| SimHash | e95558408fc3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /wp-content/*.js |
| Allow | /wp-includes/*.css |
| Disallow | /cgi-bin |
| Disallow | /wp-content/plugins/ |
| Disallow | /wp-includes/ |
| Disallow | /tag/*/page/ |
| Disallow | /tag/*/feed/ |
| Disallow | /*? |
| Disallow | /*trackback |
| Allow | /feed/$ |
| Disallow | /feed/ |
| Disallow | /*/trackback/$ |
| Disallow | /*/*/feed/$ |
| Disallow | /*/*/feed/rss/$ |
| Disallow | /*/*/trackback/$ |
| Disallow | /*/*/*/feed/$ |
| Disallow | /*/*/*/feed/rss/$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.engineeringstructures.com.au/sitemapindex.xml |