ozsale.com.au
robots.txt

Robots Exclusion Standard data for ozsale.com.au

Resource Scan

Scan Details

Site Domain ozsale.com.au
Base Domain ozsale.com.au
Scan Status Ok
Last Scan2024-06-25T23:51:13+00:00
Next Scan 2024-07-02T23:51:13+00:00

Last Scan

Scanned2024-06-25T23:51:13+00:00
URL https://ozsale.com.au/robots.txt
Redirect https://www.ozsale.com.au/robots.txt
Redirect Domain www.ozsale.com.au
Redirect Base ozsale.com.au
Domain IPs 23.54.118.37, 23.54.118.39, 2600:1413:a000::172c:442, 2600:1413:a000::172c:452
Redirect IPs 23.54.118.37, 23.54.118.39, 2600:1417:3f::b81c:eb52, 2600:1417:3f::b81c:eb69
Response IP 23.52.171.232
Found Yes
Hash 8c67cdefec1a8f9fcd33c0ea9ab434144b25f6116312d49a8a9cabd1b402801d
SimHash e8400891e11a

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

facebookexternalhit
facebot

Rule Path
Allow /giftcard.aspx

*

Rule Path
Allow /
Disallow /my-account
Disallow /phoneorders.aspx
Disallow /myaccount.aspx
Disallow /checkout.aspx
Disallow /login.aspx
Disallow /signup.aspx
Disallow /join.aspx
Disallow /inviteafriend.aspx
Disallow /aboutus.aspx
Disallow /help.aspx
Disallow /giftcard.aspx
Disallow /api/shop/auth/
Disallow /shop/sale/*
Disallow /wishlist

Other Records

Field Value
sitemap https://www.ozsale.com.au/site-maps/ozsale_com_au_sitemapindex.xml