comparedev.com.au
robots.txt
Robots Exclusion Standard data for comparedev.com.au
Resource Scan
Scan Details
Site Domain | comparedev.com.au |
Base Domain | comparedev.com.au |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-08T21:37:34+00:00 |
Next Scan | 2024-12-07T21:37:34+00:00 |
Last Successful Scan
Scanned | 2024-04-19T16:40:50+00:00 |
URL | https://www.comparedev.com.au/robots.txt |
Domain IPs | 13.35.18.103, 13.35.18.114, 13.35.18.118, 13.35.18.93 |
Response IP | 13.35.18.114 |
Found | Yes |
Hash | 85e6f7e28dfa8188499db94d6087bb8f8e9f67d5f79da134318a38e59d8cb93e |
SimHash | 49501071c513 |
Other Records
Field | Value |
---|---|
sitemap | https://www.compareandconnect.com.au/sitemap.xml |