gapengineering.com.au
robots.txt
Robots Exclusion Standard data for gapengineering.com.au
Resource Scan
Scan Details
| Site Domain | gapengineering.com.au |
| Base Domain | gapengineering.com.au |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-05-27T07:31:40+00:00 |
| Next Scan | 2025-07-26T07:31:40+00:00 |
Last Successful Scan
| Scanned | 2025-03-06T07:24:11+00:00 |
| URL | https://gapengineering.com.au/robots.txt |
| Domain IPs | 104.21.33.138, 172.67.190.31, 2606:4700:3033::6815:218a, 2606:4700:3037::ac43:be1f |
| Response IP | 172.67.190.31 |
| Found | Yes |
| Hash | 0ba675b1ed9a46ad25277f85ef322094e67967ad2017e04759c19db40a23bf49 |
| SimHash | 70045840cd93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/author |
| Disallow | /*/author* |
| Disallow | /*/author/ |
| Disallow | /*/author/* |
Other Records
| Field | Value |
|---|---|
| sitemap | sitemap_index.xml |
Warnings
- 1 invalid line.
Comments