comparedev.com.au
robots.txt

Robots Exclusion Standard data for comparedev.com.au

Resource Scan

Scan Details

Site Domain comparedev.com.au
Base Domain comparedev.com.au
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-10T21:26:36+00:00
Next Scan 2024-07-10T21:26:36+00:00

Last Successful Scan

Scanned2024-04-19T16:40:50+00:00
URL https://www.comparedev.com.au/robots.txt
Domain IPs 13.35.18.103, 13.35.18.114, 13.35.18.118, 13.35.18.93
Response IP 13.35.18.114
Found Yes
Hash 85e6f7e28dfa8188499db94d6087bb8f8e9f67d5f79da134318a38e59d8cb93e
SimHash 49501071c513

Groups

*

Rule Path
Disallow /inc/ajax/*
Allow /

Other Records

Field Value
sitemap https://www.compareandconnect.com.au/sitemap.xml