revolveclothing.com.au
robots.txt

Robots Exclusion Standard data for revolveclothing.com.au

Resource Scan

Scan Details

Site Domain revolveclothing.com.au
Base Domain revolveclothing.com.au
Scan Status Ok
Last Scan2024-09-22T22:54:47+00:00
Next Scan 2024-10-06T22:54:47+00:00

Last Scan

Scanned2024-09-22T22:54:47+00:00
URL https://revolveclothing.com.au/robots.txt
Redirect https://www.revolveclothing.com.au/robots.txt
Redirect Domain www.revolveclothing.com.au
Redirect Base revolveclothing.com.au
Domain IPs 23.52.40.26, 23.52.40.34
Redirect IPs 184.50.85.153, 96.17.180.24
Response IP 96.17.180.42
Found Yes
Hash 726a6b6c9678a53df136dda17b643fa5e1b996e2207b2525d424cc20da12c24c
SimHash 49242eb10233

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /WEB-INF/
Disallow /b/
Disallow /beta/
Disallow /productpages/
Disallow /hgg/
Disallow /classic/
Disallow /images/
Disallow /Unsubscribe.jsp
Disallow /luckybreaks/
Disallow /brandinfopages/
Disallow /beta3/
Disallow /fwd/Shipping.jsp
Disallow /fwd/AboutUs.jsp
Disallow /fwd/CustomerService.jsp
Disallow /fwd/Guarantee.jsp
Disallow /fwd/ReturnPolicy.jsp
Disallow /fwd/FAQ.jsp
Disallow /fwd/MyAccount.jsp
Disallow /fwd/LoginOrCreateAccount.jsp
Disallow /fwd/PrivacyPolicy.jsp
Disallow /blog/ViewFullPost.jsp
Disallow /fw/
Disallow /r/PageTrack.jsp
Disallow /r/mobile/PageTrack.jsp
Disallow /edit/
Disallow /blognew/
Disallow /images/emailpics/
Disallow /f/
Disallow /magazine/
Disallow /w/
Disallow /mobile/Checkout.jsp
Disallow /r/ShoppingBag.jsp
Disallow /r/ajax/

Other Records

Field Value
sitemap https://www.revolveclothing.com.au/scripts/rev_sitemap/en-au/rev_sitemap_index.xml

Comments

  • Block GPT crawler