webfind.com.au
robots.txt
Robots Exclusion Standard data for webfind.com.au
Resource Scan
Scan Details
| Site Domain | webfind.com.au |
| Base Domain | webfind.com.au |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-03-25T12:02:31+00:00 |
| Next Scan | 2024-06-23T12:02:31+00:00 |
Last Successful Scan
| Scanned | 2023-05-03T21:10:17+00:00 |
| URL | https://webfind.com.au/robots.txt |
| Domain IPs | 104.21.65.150, 172.67.146.172, 2606:4700:3033::6815:4196, 2606:4700:3036::ac43:92ac |
| Response IP | 104.21.65.150 |
| Found | Yes |
| Hash | a83d2752ddcf0797fa5bee41f32c91b3418fafec4df13635873fb9a9429dddcb |
| SimHash | ea285c48c892 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.webfind.com.au/sitemap.xml |