levis.com.au
robots.txt
Robots Exclusion Standard data for levis.com.au
Resource Scan
Scan Details
Site Domain | levis.com.au |
Base Domain | levis.com.au |
Scan Status | Ok |
Last Scan | 2024-06-09T20:49:44+00:00 |
Next Scan | 2024-07-09T20:49:44+00:00 |
Last Scan
Scanned | 2024-06-09T20:49:44+00:00 |
URL | https://levis.com.au/robots.txt |
Redirect | https://www.levis.com.au/robots.txt |
Redirect Domain | www.levis.com.au |
Redirect Base | levis.com.au |
Domain IPs | 184.28.235.59, 184.28.235.65, 2600:1417:3f::b81c:eb59, 2600:1417:3f::b81c:eb5a |
Redirect IPs | 23.52.171.225, 23.52.171.241, 2600:1413:b000:1b::17d7:710, 2600:1413:b000:1b::17d7:71c |
Response IP | 23.52.171.241 |
Found | Yes |
Hash | d17666f265913e8251f07ba90fe78e8f744d9847e2bd6cd04cc90a1d7187f98b |
SimHash | 8179ce228e57 |
Groups
*
Rule | Path |
---|---|
Disallow | /Account-CreateAccount |
Disallow | /Account-Show |
Disallow | /Account-PasswordResetDialog |
Disallow | /Account-PasswordReset |
Disallow | /Account-SetNewPassword |
Disallow | /Account-SetNewPasswordConfirm |
Disallow | /Account-UpdateName |
Disallow | /Account-RegistrationConfirm |
Disallow | /Address-List |
Disallow | /PaymentInstruments-List/ |
Disallow | /Order-Track/ |
Disallow | /Wishlist-Show/ |
Disallow | /COShipping-Start |
Disallow | /COSummary-Submit |
Disallow | /Cart-Show |
Disallow | /accountemail |
Disallow | /accountname |
Disallow | /accountpassword |
Disallow | /orderstatus |
Disallow | /account |
Disallow | /addresses |
Disallow | /shipping |
Disallow | /orderconfirmation |
Disallow | /cart |
Disallow | *search?q=* |
Disallow | /*prefn* |
Disallow | /*prefv* |
Disallow | /*pmin%3D* |
Disallow | /*pmax%3D* |
Disallow | /*prefn2%3D* |
Disallow | /*prefv2%3D* |
Disallow | /*start%3D* |
Disallow | */on/demandware.store/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.levis.com.au/sitemap_index.xml |