Log In Sign Up

newegg.ca
robots.txt

Robots Exclusion Standard data for newegg.ca

Resource Scan

Scan Details

Site Domain newegg.ca
Base Domain newegg.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-06T15:09:53+00:00
Next Scan 2024-12-05T15:09:53+00:00

Last Successful Scan

Scanned2022-11-13T03:37:35+00:00
URL https://newegg.ca/robots.txt
Redirect https://www.newegg.ca/robots.txt
Redirect Domain www.newegg.ca
Redirect Base newegg.ca
Response IP 23.207.181.4
Found Yes
Hash 46b3c277bb4d4a10b48f901053f5eb824ea7b29c85202c43262da9953ed8c356
SimHash 0e56e7bba679

Groups

*

Rule Path
Disallow /Common/BML/
Disallow /Common/ThirdParty/
Disallow /App/
Disallow /Application/
Disallow /Configuration/
Disallow /NewMyAccount/
Disallow /MyNewegg/
Allow /info/newsroomdetail.aspx
Allow /.well-known/assetlinks.json
Disallow /insider/blog/wp-admin/
Disallow /api/UpdateStorage
Disallow /api/TrendingNow
Disallow /mycountry
Disallow /api/MiniCart
Disallow /api/GetStorage
Disallow /areyouahuman

changedetection

Rule Path
Disallow /

nutch

Rule Path
Disallow /

*

Rule Path
Disallow /m/ajax/getMiniCartApi
Disallow /m/ajax/addItemApi
Disallow /m/product/Overview/Landingpage
Disallow /m/ajax/updateStorageApi
Disallow /m/home/ajax/updateStorageApi
Disallow /m/search/ajax/updateStorageApi
Disallow /m/product/ajax/updateStorageApi
Disallow /m/mktplace/ajax/updateStorageApi
Disallow /m/diy/ajax/updateStorageApi
Disallow /m/account/ajax/updateStorageApi
Disallow /m/shoppingflow/ajax/updateStorageApi
Disallow /m/wishlist/ajax/updateStorageApi
Disallow /m/order/ajax/updateStorageApi
Disallow /m/notification/ajax/updateStorageApi
Disallow /m/ajax/getStorageApi
Disallow /m/home/ajax/getStorageApi
Disallow /m/search/ajax/getStorageApi
Disallow /m/product/ajax/getStorageApi
Disallow /m/mktplace/ajax/getStorageApi
Disallow /m/store/ajax/getStorageApi
Disallow /m/account/ajax/getStorageApi
Disallow /m/shoppingflow/ajax/getStorageApi
Disallow /m/wishlist/ajax/getStorageApi
Disallow /m/notification/ajax/getStorageApi
Disallow /m/ajax/deleteStorageApi
Disallow /m/home/ajax/deleteStorageApi
Disallow /m/search/ajax/deleteStorageApi
Disallow /m/product/ajax/deleteStorageApi
Disallow /m/shoppingflow/ajax/deleteStorageApi
Disallow /m/wishlist/ajax/deleteStorageApi
Disallow /m/ajax/getUnreadList
Disallow /m/home/ajax/getUnreadList
Disallow /m/mktplace/ajax/getUnreadList
Disallow /m/product/ajax/getUnreadList
Disallow /m/promotion/ajax/getUnreadList
Disallow /m/search/ajax/getUnreadList
Disallow /m/store/ajax/getUnreadList
Disallow /m/diy/ajax/getUnreadList
Back to top

Comments

  • Newegg Robots.txt File
  • DESKTOP - START
  • Original version disallows
  • Allows updated 12/20/21 .ca
  • blog disallows updated 6/11/18
  • disallows API call 8/2/2022
  • DESKTOP - END
  • MOBILE - START
  • disallows API call 8/2/2022
  • MOBILE - END
Back to top

Warnings

  • 2 invalid lines.
Back to top