jamesallen.com
robots.txt

Robots Exclusion Standard data for jamesallen.com

Resource Scan

Scan Details

Site Domain jamesallen.com
Base Domain jamesallen.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-08T06:21:58+00:00
Next Scan 2024-11-06T06:21:58+00:00

Last Successful Scan

Scanned2024-03-19T06:20:11+00:00
URL https://jamesallen.com/robots.txt
Redirect https://www.jamesallen.com/robots.txt
Redirect Domain www.jamesallen.com
Redirect Base jamesallen.com
Domain IPs 38.69.200.2
Redirect IPs 23.210.105.201
Response IP 104.91.84.25
Found Yes
Hash 77dd77eb6277dc644ed0f132441efc4f9bb3b2b3b32637b68bb875f9ac0f7330
SimHash 1c5c44776bf2

Groups

*

Rule Path
Disallow /*?*
Disallow /*_facebook.flv
Disallow /grading_report.asp?pic=
Disallow /bestSellers/
Disallow /mobile/sears-login/
Disallow /matching-pairs-desktop/
Disallow /mobile/new-header/
Disallow /sears-login/
Disallow /newfinejewelry/*
Disallow /how-he-asked/*
Disallow /EducationMenu/*
Disallow /mobile/complete-rings/*
Disallow /complete-rings/*
Disallow /*javascript*
Disallow /javascript*
Disallow /sign-up-email-list/*
Disallow /email/*
Disallow /japlayer/*
Disallow /completed-engagement-ring/*
Disallow /player/*
Disallow /sale/*
Disallow /amazing-homepage/*
Disallow /really-amazing-homepage/*
Disallow /homepage1/*
Disallow /homepage2/*
Disallow /wishlist/*
Disallow /react-gallery/*
Disallow /finalizeorder/*
Disallow /consult/*
Disallow /OrderAnalysis/*
Disallow /jewelgallery/*
Disallow /mothersday/*
Disallow /gallery/*
Disallow /homepagetest/*
Disallow /valentines-day/*
Disallow /accountactivation/*
Disallow /recently-sold/*
Disallow /thank-you/*
Disallow /onlymenu/*
Disallow /RenderTest1/*
Disallow /RenderTest2/*
Disallow /unsubscribe/*
Disallow /unsubscribewh/*
Disallow /referralswh/*
Disallow /amazon-ipn/*
Disallow /loginCheckout/*
Disallow /OrderAnalysis/*
Disallow /accountactivation/*
Disallow /exclusive-offers/*
Disallow /finalizeorder/*
Disallow /paridesktop/*
Disallow /tempgetinspireditem/*
Disallow /resetpassword/*
Disallow /cybermonday/*
Disallow /gemstone-certificate/
Disallow /content/modules/google/scripts.aspx
Disallow /sr*
Disallow /shop_bag_billing/
Disallow /shoppingcart/
Disallow /wizard/
Disallow /wizarditempage/
Disallow /wizardGallery/
Disallow /pandora/
Disallow /howru/
Disallow /authentication/
Disallow /EngagementMoments/*
Disallow /education/fine-jewelry-online/pendants-new.html
Disallow /education/fine-jewelry-online/pearl-new.html
Disallow /education/wedding-rings/how-to-choose-new.html
Disallow /instagram-giveaway/
Disallow /testNimrod/
Disallow /ringhunt/
Disallow /akamai/*
Disallow /*%26*
Disallow /demo-gallery/*
Disallow /theskimm-royal-engagement-rings/*
Disallow /mobile/theskimm-royal-engagement-rings/*
Disallow /brand-ambassadors/*
Disallow /mobile/brand-ambassadors/*
Disallow /referfriend/
Disallow /engagement-ring-giveaway/*
Allow /*?cur=*
Allow /*?km_source=*
Allow /complete-ring/*?*
Allow /loose-diamonds/round-cut/?Cut=TrueHearts
Allow /loose-diamonds/all-diamonds/?CM=True
Allow /JSite/Core/jx.ashx?PageUrl=cart-dropdown%2F*
Allow /mobile/*
Disallow /mobile/data.asp?ItemID=*
Disallow /mobiletest/*
Disallow /mobile/ese*
Disallow /mobile/pariopen/*
Disallow /mobile/mobile-popups/*
Disallow /mobile/GoAllIn/
Disallow /mobile/demo-gallery/*
Disallow /socialmediagallery/

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0.8

Other Records

Field Value
sitemap https://www.jamesallen.com/googlexml/ja-site-links.xml
sitemap https://blog.jamesallen.com/post-sitemap.xml