abchomes.com.au
robots.txt

Robots Exclusion Standard data for abchomes.com.au

Resource Scan

Scan Details

Site Domain abchomes.com.au
Base Domain abchomes.com.au
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-29T17:13:53+00:00
Next Scan 2024-11-27T17:13:53+00:00

Last Successful Scan

Scanned2023-11-04T04:42:07+00:00
URL https://abchomes.com.au/robots.txt
Domain IPs 13.227.254.100, 13.227.254.128, 13.227.254.35, 13.227.254.44
Response IP 52.84.18.68
Found Yes
Hash 84d3262743571440b8ef245506be066840d8d7c6fdb6942c3bb8e191d8cd7f55
SimHash 40688f5627b7

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/
Disallow /*/footer/
Disallow /footer*
Disallow /*/facade/
Disallow /facade*
Disallow /*/header/
Disallow /header*
Disallow /*/location/
Disallow /location*
Disallow /*/undefined
Disallow /undefined*

Other Records

Field Value
sitemap https://abchomes.com.au/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://abchomes.com.au/
  • live - don't allow web crawlers to index cpresources/ or vendor/