core-electronics.com.au
robots.txt

Robots Exclusion Standard data for core-electronics.com.au

Resource Scan

Scan Details

Site Domain core-electronics.com.au
Base Domain core-electronics.com.au
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-11T10:59:37+00:00
Next Scan 2026-04-11T10:59:37+00:00

Last Successful Scan

Scanned2024-08-26T21:58:43+00:00
URL https://core-electronics.com.au/robots.txt
Domain IPs 104.26.0.78, 104.26.1.78, 172.67.72.99, 2606:4700:20::681a:14e, 2606:4700:20::681a:4e, 2606:4700:20::ac43:4863
Response IP 172.67.72.99
Found Yes
Hash d132ef99c671a6aa08ee86e3b49948e5096acb6defe6b65c217edddb3a65a85d
SimHash 6931ec4bcb53

Groups

*

Rule Path
Allow /*?utm_source=google_shopping
Allow /catalog/product/view/sku/*
Disallow /*catalogsearch/result/?q=*=*
Allow /*catalogsearch/result/?q=*
Allow /*catalogsearch/result/?q=*
Disallow /*search*?q=*=*
Allow /*search?q=*
Allow /*search/?q=*
Disallow /index.php/
Disallow /*?
Disallow /checkout/
Disallow /app/
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /*SID%3D
Allow /catalog/product/view/sku/*
Disallow /catalog/

archive.org_bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://core-electronics.com.au/sitemap/sitemap.xml

Comments

  • Allow specific product SKU view path
  • Disallow other system URL paths