revolveclothing.co.jp
robots.txt

Robots Exclusion Standard data for revolveclothing.co.jp

Resource Scan

Scan Details

Site Domain revolveclothing.co.jp
Base Domain revolveclothing.co.jp
Scan Status Ok
Last Scan2024-09-23T02:40:43+00:00
Next Scan 2024-10-07T02:40:43+00:00

Last Scan

Scanned2024-09-23T02:40:43+00:00
URL https://revolveclothing.co.jp/robots.txt
Redirect https://www.revolveclothing.co.jp/robots.txt
Redirect Domain www.revolveclothing.co.jp
Redirect Base revolveclothing.co.jp
Domain IPs 23.52.40.49, 23.52.40.73
Redirect IPs 96.17.180.42, 96.17.180.51
Response IP 23.32.29.98
Found Yes
Hash 570796aca6853b73b0180615492bbfe73cd2d1d5e29b0040c8f67ae021af01b7
SimHash 49222eb10233

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /WEB-INF/
Disallow /b/
Disallow /beta/
Disallow /productpages/
Disallow /hgg/
Disallow /classic/
Disallow /images/
Disallow /Unsubscribe.jsp
Disallow /luckybreaks/
Disallow /brandinfopages/
Disallow /beta3/
Disallow /fwd/Shipping.jsp
Disallow /fwd/AboutUs.jsp
Disallow /fwd/CustomerService.jsp
Disallow /fwd/Guarantee.jsp
Disallow /fwd/ReturnPolicy.jsp
Disallow /fwd/FAQ.jsp
Disallow /fwd/MyAccount.jsp
Disallow /fwd/LoginOrCreateAccount.jsp
Disallow /fwd/PrivacyPolicy.jsp
Disallow /blog/ViewFullPost.jsp
Disallow /fw/
Disallow /r/PageTrack.jsp
Disallow /r/mobile/PageTrack.jsp
Disallow /edit/
Disallow /blognew/
Disallow /images/emailpics/
Disallow /f/
Disallow /magazine/
Disallow /w/
Disallow /mobile/Checkout.jsp
Disallow /r/ShoppingBag.jsp
Disallow /r/ajax/

Other Records

Field Value
sitemap https://www.revolve.com/scripts/rev_sitemap/rev_sitemap_index.xml

Comments

  • Block GPT crawler