rakuten.co.uk
robots.txt
Robots Exclusion Standard data for rakuten.co.uk
Resource Scan
Scan Details
Site Domain | rakuten.co.uk |
Base Domain | rakuten.co.uk |
Scan Status | Ok |
Last Scan | 2024-05-27T12:14:32+00:00 |
Next Scan | 2024-06-03T12:14:32+00:00 |
Last Scan
Scanned | 2024-05-27T12:14:32+00:00 |
URL | https://rakuten.co.uk/robots.txt |
Domain IPs | 23.48.169.59, 23.48.169.64 |
Response IP | 23.48.169.59 |
Found | Yes |
Hash | b4f3e1f95e9ddb946691103a0f88d37a6bfc7316a54a29c0766000458326c8e5 |
SimHash | 580d9143c68f |
Groups
*
Rule | Path |
---|---|
Disallow | *disallow%3D1* |
Disallow | /.well-known/ |
Disallow | /*-xfas |
Disallow | /*-xfcat |
Disallow | /product/ |
Disallow | /prod-cats/ |
Disallow | /editUserInfos.do |
Disallow | /utilities/ |
Disallow | /landing_merchant.jsp |
Disallow | /2010.htm |
Disallow | /compare/ |
Disallow | /searchproducts.htm |
Disallow | /searchproducts_all.htm |
Disallow | /searchcomparison.htm |
Disallow | /search/special.htm |
Disallow | /search/all.htm |
Disallow | /search/stores.htm |
Disallow | /myus/ |
Disallow | /account-info.htm |
Disallow | /whitelist/ |
Disallow | /*?referrerid |
Disallow | /*%26campaign_entity_id |
Disallow | /*%26sourceName |
Disallow | /*%26eeid |
Disallow | /*%26sourceId |
Disallow | /*%26src |
Disallow | /*%26utm_source |
Disallow | /*%26utm_medium |
Disallow | /*%26utm_campaign |
Disallow | /*%26AutoLoginID |
Disallow | /*%26mpl_id |
Disallow | /*%26referrid |
Disallow | /*%26referrerdid |
Disallow | /*%26referrer |
Disallow | /unifiedSearch/ |
Disallow | /refer-a-friend/ |
Disallow | /frontendEvents.do |
Disallow | /button/ |
Disallow | /giveaway_rules/ |
Disallow | /wp-json/ |
Disallow | /feed/merchant-feed.xml |
Disallow | /feed/offer-feed.xml |
Disallow | /customer/feed/offer-feed.xml |
Disallow | /customer/feed/merchant-feed.xml |
Disallow | /logonUserServicesStartupAction.do |
Disallow | /myaccount/ |
Disallow | /pending-cash-back.htm |
Disallow | /sem/ |
Disallow | /ebatesCaptcha.do |
Disallow | /mobile/ |
Disallow | /cgi-bin/ |
Disallow | /email/ |
Disallow | /account/ |
Disallow | /ajax/ |
Disallow | /auth/getLogonForm.do |
Disallow | /zh/index.htm |
Disallow | /kr/index.htm |
Disallow | /sg/index.htm |
Disallow | /sem2015/ |
Disallow | /ad-scans/ |
Disallow | /_stores/ |
Disallow | /kr/ |
Disallow | *bvstate%3D |
Disallow | *maxp%3D |
Disallow | *minp%3D |
Disallow | *rtg%3D |
Disallow | *po_c%3D |
Disallow | *bo%3D |
Disallow | *queryId%3D |
Disallow | *querySubId%3D |
Disallow | /*.vm |
Disallow | /shop/search/ |
Disallow | /shop/*/search/ |
Disallow | /shop/member/ |
Disallow | /shop/order/ |
Disallow | /shop/messages/ |
Disallow | /shop/wishlist/ |
Disallow | /shop/mycoupons/ |
Disallow | /shop/browsing_history/ |
Disallow | /shop/preference-center-rmail/ |
Disallow | /amexblue/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.rakuten.co.uk/sitemap.xml |