dealsdirect.com.au
robots.txt

Robots Exclusion Standard data for dealsdirect.com.au

Resource Scan

Scan Details

Site Domain dealsdirect.com.au
Base Domain dealsdirect.com.au
Scan Status Ok
Last Scan2024-11-12T06:29:33+00:00
Next Scan 2024-11-19T06:29:33+00:00

Last Scan

Scanned2024-11-12T06:29:33+00:00
URL https://dealsdirect.com.au/robots.txt
Redirect https://www.dealsdirect.com.au/robots.txt
Redirect Domain www.dealsdirect.com.au
Redirect Base dealsdirect.com.au
Domain IPs 23.215.7.12, 23.215.7.17, 2600:1413:b000:1b::17d7:70c, 2600:1413:b000:1b::17d7:711
Redirect IPs 23.209.46.138, 23.209.46.148, 2600:1413:b000:1b::17d7:70c, 2600:1413:b000:1b::17d7:711
Response IP 23.215.7.12
Found Yes
Hash 7b35d27f06ba20e5138cdbe2e0a1eebbb5ad25af4369cd343a29a5f869cb088e
SimHash e9420891e11a

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

facebookexternalhit
facebot

Rule Path
Allow /giftcard.aspx

*

Rule Path
Allow /
Disallow /my-account
Disallow /phoneorders.aspx
Disallow /myaccount.aspx
Disallow /checkout.aspx
Disallow /login.aspx
Disallow /signup.aspx
Disallow /join.aspx
Disallow /inviteafriend.aspx
Disallow /aboutus.aspx
Disallow /help.aspx
Disallow /giftcard.aspx
Disallow /api/shop/auth/
Disallow /shop/sale/*
Disallow /wishlist

Other Records

Field Value
sitemap https://www.dealsdirect.com.au/site-maps/dealsdirect_com_au_sitemapindex.xml