revolveclothing.es
robots.txt

Robots Exclusion Standard data for revolveclothing.es

Resource Scan

Scan Details

Site Domain revolveclothing.es
Base Domain revolveclothing.es
Scan Status Ok
Last Scan2024-09-22T07:03:25+00:00
Next Scan 2024-10-06T07:03:25+00:00

Last Scan

Scanned2024-09-22T07:03:25+00:00
URL https://revolveclothing.es/robots.txt
Redirect https://www.revolveclothing.es/robots.txt
Redirect Domain www.revolveclothing.es
Redirect Base revolveclothing.es
Domain IPs 23.52.40.49, 23.52.40.73
Redirect IPs 23.32.29.107, 23.32.29.98
Response IP 104.88.71.104
Found Yes
Hash abc69bf2d52c532c0a4b5dc4200458092f31fdb1cebec525d6a811dd16dae103
SimHash 49206eb10233

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /WEB-INF/
Disallow /b/
Disallow /beta/
Disallow /productpages/
Disallow /hgg/
Disallow /classic/
Disallow /images/
Disallow /Unsubscribe.jsp
Disallow /luckybreaks/
Disallow /brandinfopages/
Disallow /beta3/
Disallow /fwd/Shipping.jsp
Disallow /fwd/AboutUs.jsp
Disallow /fwd/CustomerService.jsp
Disallow /fwd/Guarantee.jsp
Disallow /fwd/ReturnPolicy.jsp
Disallow /fwd/FAQ.jsp
Disallow /fwd/MyAccount.jsp
Disallow /fwd/LoginOrCreateAccount.jsp
Disallow /fwd/PrivacyPolicy.jsp
Disallow /blog/ViewFullPost.jsp
Disallow /fw/
Disallow /r/PageTrack.jsp
Disallow /r/mobile/PageTrack.jsp
Disallow /edit/
Disallow /blognew/
Disallow /images/emailpics/
Disallow /f/
Disallow /magazine/
Disallow /w/
Disallow /mobile/Checkout.jsp
Disallow /r/ShoppingBag.jsp
Disallow /r/ajax/

Other Records

Field Value
sitemap https://www.revolveclothing.es/scripts/rev_sitemap/es/rev_sitemap_index.xml

Comments

  • Block GPT crawler