ozsale.com.au
robots.txt

Robots Exclusion Standard data for ozsale.com.au

Resource Scan

Scan Details

Site Domain ozsale.com.au
Base Domain ozsale.com.au
Scan Status Ok
Last Scan2024-06-11T23:50:29+00:00
Next Scan 2024-06-18T23:50:29+00:00

Last Scan

Scanned2024-06-11T23:50:29+00:00
URL https://ozsale.com.au/robots.txt
Redirect https://www.ozsale.com.au/robots.txt
Redirect Domain www.ozsale.com.au
Redirect Base ozsale.com.au
Domain IPs 23.52.171.232, 23.59.168.144, 2600:1413:b000:1b::17d7:70c, 2600:1413:b000:1b::17d7:715
Redirect IPs 23.59.168.112, 2600:1413:b000:1b::17d7:70c, 2600:1413:b000:1b::17d7:715
Response IP 23.52.171.232
Found Yes
Hash 8c67cdefec1a8f9fcd33c0ea9ab434144b25f6116312d49a8a9cabd1b402801d
SimHash e8400891e11a

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

facebookexternalhit
facebot

Rule Path
Allow /giftcard.aspx

*

Rule Path
Allow /
Disallow /my-account
Disallow /phoneorders.aspx
Disallow /myaccount.aspx
Disallow /checkout.aspx
Disallow /login.aspx
Disallow /signup.aspx
Disallow /join.aspx
Disallow /inviteafriend.aspx
Disallow /aboutus.aspx
Disallow /help.aspx
Disallow /giftcard.aspx
Disallow /api/shop/auth/
Disallow /shop/sale/*
Disallow /wishlist

Other Records

Field Value
sitemap https://www.ozsale.com.au/site-maps/ozsale_com_au_sitemapindex.xml