Log In Sign Up

www2.newegg.com
robots.txt

Robots Exclusion Standard data for www2.newegg.com

Resource Scan

Scan Details

Site Domain www2.newegg.com
Base Domain newegg.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-23T12:56:00+00:00
Next Scan 2024-06-21T12:56:00+00:00

Last Successful Scan

Scanned2022-11-07T04:55:42+00:00
URL https://www2.newegg.com/robots.txt
Redirect https://www.newegg.com/robots.txt
Redirect Domain www.newegg.com
Redirect Base newegg.com
Response IP 104.69.145.233
Found Yes
Hash bd841a558e95a3eb594382066954511688404bfc6f780097f17e8834c45b0890
SimHash 0756e7b3a679

Groups

*

Rule Path
Disallow /Common/BML/
Disallow /Common/ThirdParty/
Disallow /App/
Disallow /Application/
Disallow /Configuration/
Disallow /NewMyAccount/
Disallow /MyNewegg/
Allow /info/newsroomdetail.aspx
Allow /.well-known/assetlinks.json
Disallow /insider/blog/wp-admin/
Disallow /api/UpdateStorage
Disallow /api/TrendingNow
Disallow /mycountry
Disallow /api/MiniCart
Disallow /api/GetStorage
Disallow /areyouahuman

changedetection

Rule Path
Disallow /

nutch

Rule Path
Disallow /

*

Rule Path
Disallow /m/ajax/getMiniCartApi
Disallow /m/ajax/addItemApi
Disallow /m/product/Overview/Landingpage
Disallow /m/ajax/updateStorageApi
Disallow /m/home/ajax/updateStorageApi
Disallow /m/search/ajax/updateStorageApi
Disallow /m/product/ajax/updateStorageApi
Disallow /m/mktplace/ajax/updateStorageApi
Disallow /m/diy/ajax/updateStorageApi
Disallow /m/account/ajax/updateStorageApi
Disallow /m/shoppingflow/ajax/updateStorageApi
Disallow /m/wishlist/ajax/updateStorageApi
Disallow /m/order/ajax/updateStorageApi
Disallow /m/notification/ajax/updateStorageApi
Disallow /m/ajax/getStorageApi
Disallow /m/home/ajax/getStorageApi
Disallow /m/search/ajax/getStorageApi
Disallow /m/product/ajax/getStorageApi
Disallow /m/mktplace/ajax/getStorageApi
Disallow /m/store/ajax/getStorageApi
Disallow /m/account/ajax/getStorageApi
Disallow /m/shoppingflow/ajax/getStorageApi
Disallow /m/wishlist/ajax/getStorageApi
Disallow /m/notification/ajax/getStorageApi
Disallow /m/ajax/deleteStorageApi
Disallow /m/home/ajax/deleteStorageApi
Disallow /m/search/ajax/deleteStorageApi
Disallow /m/product/ajax/deleteStorageApi
Disallow /m/shoppingflow/ajax/deleteStorageApi
Disallow /m/wishlist/ajax/deleteStorageApi
Disallow /m/ajax/getUnreadList
Disallow /m/home/ajax/getUnreadList
Disallow /m/mktplace/ajax/getUnreadList
Disallow /m/product/ajax/getUnreadList
Disallow /m/promotion/ajax/getUnreadList
Disallow /m/search/ajax/getUnreadList
Disallow /m/store/ajax/getUnreadList
Disallow /m/diy/ajax/getUnreadList
Back to top

Comments

  • Newegg Robots.txt File
  • DESKTOP - START
  • Original version disallows
  • Allows updated 12/20/21
  • blog disallows updated 6/11/18
  • disallows API call 8/2/2022
  • DESKTOP - END
  • MOBILE - START
  • disallows API call 8/2/2022
  • MOBILE - END
Back to top

Warnings

  • 2 invalid lines.
Back to top