rakuten.com
robots.txt
Robots Exclusion Standard data for rakuten.com
Resource Scan
Scan Details
| Site Domain | rakuten.com |
| Base Domain | rakuten.com |
| Scan Status | Ok |
| Last Scan | 2024-05-01T01:30:45+00:00 |
| Next Scan | 2024-05-08T01:30:45+00:00 |
Last Scan
| Scanned | 2024-05-01T01:30:45+00:00 |
| URL | https://www.rakuten.com/robots.txt |
| Domain IPs | 23.210.107.66 |
| Response IP | 23.202.136.24 |
| Found | Yes |
| Hash | 8bccbc078da0f012742040175fe4dfabddedf46303e466ff0ec112aa8eeaab56 |
| SimHash | 4c0c9163468e |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *disallow%3D1* |
| Disallow | /.well-known/ |
| Disallow | /*-xfas |
| Disallow | /*-xfcat |
| Disallow | /product/ |
| Disallow | /prod-cats/ |
| Disallow | /editUserInfos.do |
| Disallow | /utilities/ |
| Disallow | /landing_merchant.jsp |
| Disallow | /2010.htm |
| Disallow | /compare/ |
| Disallow | /searchproducts.htm |
| Disallow | /searchproducts_all.htm |
| Disallow | /searchcomparison.htm |
| Disallow | /search/special.htm |
| Disallow | /search/all.htm |
| Disallow | /search/stores.htm |
| Disallow | /myus/ |
| Disallow | /account-info.htm |
| Disallow | /whitelist/ |
| Disallow | /*?referrerid |
| Disallow | /*%26campaign_entity_id |
| Disallow | /*%26sourceName |
| Disallow | /*%26eeid |
| Disallow | /*%26sourceId |
| Disallow | /*%26src |
| Disallow | /*%26utm_source |
| Disallow | /*%26utm_medium |
| Disallow | /*%26utm_campaign |
| Disallow | /*%26AutoLoginID |
| Disallow | /*%26mpl_id |
| Disallow | /*%26referrid |
| Disallow | /*%26referrerdid |
| Disallow | /*%26referrer |
| Disallow | /unifiedSearch/ |
| Disallow | /refer-a-friend/ |
| Disallow | /frontendEvents.do |
| Disallow | /button/ |
| Disallow | /giveaway_rules/ |
| Disallow | /wp-json/ |
| Disallow | /feed/merchant-feed.xml |
| Disallow | /feed/offer-feed.xml |
| Disallow | /customer/feed/offer-feed.xml |
| Disallow | /customer/feed/merchant-feed.xml |
| Disallow | /logonUserServicesStartupAction.do |
| Disallow | /myaccount/ |
| Disallow | /pending-cash-back.htm |
| Disallow | /sem/ |
| Disallow | /ebatesCaptcha.do |
| Disallow | /mobile/ |
| Disallow | /cgi-bin/ |
| Disallow | /blog-preview/ |
| Disallow | /blog/wp-includes/ |
| Disallow | /blog/wp-login.php |
| Disallow | /blog/wp-admin/* |
| Disallow | /blog/wp-register.php |
| Disallow | /blog/search/* |
| Disallow | /email/ |
| Disallow | /account/ |
| Disallow | /ajax/ |
| Disallow | /auth/getLogonForm.do |
| Disallow | /zh/index.htm |
| Disallow | /kr/index.htm |
| Disallow | /sg/index.htm |
| Disallow | /sem2015/ |
| Disallow | /ad-scans/ |
| Disallow | /_stores/ |
| Disallow | /hotels/search-results.htm |
| Disallow | /hotels/verify.htm |
| Disallow | /hotels/reservation-management.htm |
| Disallow | /hotels/reservation-payment.htm |
| Disallow | /hotels/reservation-confirmation.htm |
| Disallow | /kr/ |
| Disallow | /blog1/ |
| Disallow | *bvstate%3D |
| Disallow | *maxp%3D |
| Disallow | *minp%3D |
| Disallow | *rtg%3D |
| Disallow | *po_c%3D |
| Disallow | *bo%3D |
| Disallow | *queryId%3D |
| Disallow | *querySubId%3D |
| Disallow | /*.vm |
| Disallow | /sorting/ |
| Disallow | /m/ |
| Disallow | /shop/search/ |
| Disallow | /shop/*/search/ |
| Disallow | /shop/member/ |
| Disallow | /shop/order/ |
| Disallow | /shop/messages/ |
| Disallow | /shop/wishlist/ |
| Disallow | /shop/mycoupons/ |
| Disallow | /shop/browsing_history/ |
| Disallow | /shop/preference-center-rmail/ |
| Disallow | /amexblue/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.rakuten.com/sitemap-index.xml |
| sitemap | https://www.rakuten.com/products/product_sitemap.xml |