paulaschoice.com.au
robots.txt

Robots Exclusion Standard data for paulaschoice.com.au

Resource Scan

Scan Details

Site Domain paulaschoice.com.au
Base Domain paulaschoice.com.au
Scan Status Ok
Last Scan2024-10-18T08:20:15+00:00
Next Scan 2024-11-17T08:20:15+00:00

Last Scan

Scanned2024-10-18T08:20:15+00:00
URL https://paulaschoice.com.au/robots.txt
Redirect https://www.paulaschoice.com.au/robots.txt
Redirect Domain www.paulaschoice.com.au
Redirect Base paulaschoice.com.au
Domain IPs 34.213.106.51, 54.68.182.72
Redirect IPs 23.32.29.104, 23.32.29.89
Response IP 23.32.29.89
Found Yes
Hash 71347fb7b8275d17e678d4688af33fabb2b19f3f4d2f82a65b8ab41905225fcc
SimHash 650cdd344db6

Groups

*

Rule Path
Disallow /cart
Disallow /account
Disallow */Search-Show
Disallow */Customer-
Disallow */Compare-Show
Disallow */Account-
Disallow */Checkout-
Disallow /s/paulaschoice_us

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.paulaschoice.com.au/sitemap_index.xml

Comments

  • slow down bingbot