revolve.co.kr
robots.txt

Robots Exclusion Standard data for revolve.co.kr

Resource Scan

Scan Details

Site Domain revolve.co.kr
Base Domain revolve.co.kr
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-11-13T13:34:17+00:00
Next Scan 2024-11-27T13:34:17+00:00

Last Successful Scan

Scanned2024-10-22T13:33:46+00:00
URL https://revolve.co.kr/robots.txt
Redirect https://www.revolve.co.kr/robots.txt
Redirect Domain www.revolve.co.kr
Redirect Base revolve.co.kr
Domain IPs 23.39.160.228, 23.39.160.229
Redirect IPs 23.215.7.15, 23.215.7.17
Response IP 23.52.40.26
Found Yes
Hash fd60ce9444c318744bcff7344d2b6ae2221137cfbedb471a519491d4d3c62a88
SimHash 41202eb10233

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /WEB-INF/
Disallow /b/
Disallow /beta/
Disallow /productpages/
Disallow /hgg/
Disallow /classic/
Disallow /images/
Disallow /Unsubscribe.jsp
Disallow /luckybreaks/
Disallow /brandinfopages/
Disallow /beta3/
Disallow /fwd/Shipping.jsp
Disallow /fwd/AboutUs.jsp
Disallow /fwd/CustomerService.jsp
Disallow /fwd/Guarantee.jsp
Disallow /fwd/ReturnPolicy.jsp
Disallow /fwd/FAQ.jsp
Disallow /fwd/MyAccount.jsp
Disallow /fwd/LoginOrCreateAccount.jsp
Disallow /fwd/PrivacyPolicy.jsp
Disallow /blog/ViewFullPost.jsp
Disallow /fw/
Disallow /r/PageTrack.jsp
Disallow /r/mobile/PageTrack.jsp
Disallow /edit/
Disallow /blognew/
Disallow /images/emailpics/
Disallow /f/
Disallow /magazine/
Disallow /w/
Disallow /mobile/Checkout.jsp
Disallow /r/ShoppingBag.jsp
Disallow /r/ajax/

Other Records

Field Value
sitemap https://www.revolve.co.kr/scripts/rev_sitemap/ko-kr/rev_sitemap_index.xml

Comments

  • Block GPT crawler