secure.newegg.com
robots.txt

Robots Exclusion Standard data for secure.newegg.com

Resource Scan

Scan Details

Site Domain secure.newegg.com
Base Domain newegg.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-13T14:02:35+00:00
Next Scan 2025-06-11T14:02:35+00:00

Last Successful Scan

Scanned2022-11-13T20:00:13+00:00
URL https://secure.newegg.com/robots.txt
Response IP 23.207.181.4
Found Yes
Hash a51d1eac95c29f363db1b25a0610dd6d127cd24d0b954857657bc2ed2d98fb29
SimHash 80216bcacbc1

Groups

*

Rule Path
Allow */GiftCard/*
Allow /Guest/OrderLogin.aspx*
Disallow /
Disallow */WishList/*
Disallow */Ajax/*
Disallow */EmailAFriend*
Disallow /Guest/OrderStatus.aspx*

ia_archiver

Rule Path
Disallow /

nutch

Rule Path
Disallow /