rakuten.co.uk
robots.txt

Robots Exclusion Standard data for rakuten.co.uk

Resource Scan

Scan Details

Site Domain rakuten.co.uk
Base Domain rakuten.co.uk
Scan Status Ok
Last Scan2024-05-27T12:14:32+00:00
Next Scan 2024-06-03T12:14:32+00:00

Last Scan

Scanned2024-05-27T12:14:32+00:00
URL https://rakuten.co.uk/robots.txt
Domain IPs 23.48.169.59, 23.48.169.64
Response IP 23.48.169.59
Found Yes
Hash b4f3e1f95e9ddb946691103a0f88d37a6bfc7316a54a29c0766000458326c8e5
SimHash 580d9143c68f

Groups

*

Rule Path
Disallow *disallow%3D1*
Disallow /.well-known/
Disallow /*-xfas
Disallow /*-xfcat
Disallow /product/
Disallow /prod-cats/
Disallow /editUserInfos.do
Disallow /utilities/
Disallow /landing_merchant.jsp
Disallow /2010.htm
Disallow /compare/
Disallow /searchproducts.htm
Disallow /searchproducts_all.htm
Disallow /searchcomparison.htm
Disallow /search/special.htm
Disallow /search/all.htm
Disallow /search/stores.htm
Disallow /myus/
Disallow /account-info.htm
Disallow /whitelist/
Disallow /*?referrerid
Disallow /*%26campaign_entity_id
Disallow /*%26sourceName
Disallow /*%26eeid
Disallow /*%26sourceId
Disallow /*%26src
Disallow /*%26utm_source
Disallow /*%26utm_medium
Disallow /*%26utm_campaign
Disallow /*%26AutoLoginID
Disallow /*%26mpl_id
Disallow /*%26referrid
Disallow /*%26referrerdid
Disallow /*%26referrer
Disallow /unifiedSearch/
Disallow /refer-a-friend/
Disallow /frontendEvents.do
Disallow /button/
Disallow /giveaway_rules/
Disallow /wp-json/
Disallow /feed/merchant-feed.xml
Disallow /feed/offer-feed.xml
Disallow /customer/feed/offer-feed.xml
Disallow /customer/feed/merchant-feed.xml
Disallow /logonUserServicesStartupAction.do
Disallow /myaccount/
Disallow /pending-cash-back.htm
Disallow /sem/
Disallow /ebatesCaptcha.do
Disallow /mobile/
Disallow /cgi-bin/
Disallow /email/
Disallow /account/
Disallow /ajax/
Disallow /auth/getLogonForm.do
Disallow /zh/index.htm
Disallow /kr/index.htm
Disallow /sg/index.htm
Disallow /sem2015/
Disallow /ad-scans/
Disallow /_stores/
Disallow /kr/
Disallow *bvstate%3D
Disallow *maxp%3D
Disallow *minp%3D
Disallow *rtg%3D
Disallow *po_c%3D
Disallow *bo%3D
Disallow *queryId%3D
Disallow *querySubId%3D
Disallow /*.vm
Disallow /shop/search/
Disallow /shop/*/search/
Disallow /shop/member/
Disallow /shop/order/
Disallow /shop/messages/
Disallow /shop/wishlist/
Disallow /shop/mycoupons/
Disallow /shop/browsing_history/
Disallow /shop/preference-center-rmail/
Disallow /amexblue/

naverbot

Rule Path
Allow /kr/

yeti

Rule Path
Allow /kr/

grapeshot

Rule Path
Allow /shop/search/

Other Records

Field Value
sitemap https://www.rakuten.co.uk/sitemap.xml