winebid.com
robots.txt
Robots Exclusion Standard data for winebid.com
Resource Scan
Scan Details
| Site Domain | winebid.com |
| Base Domain | winebid.com |
| Scan Status | Ok |
| Last Scan | 2024-11-19T08:26:28+00:00 |
| Next Scan | 2024-12-03T08:26:28+00:00 |
Last Scan
| Scanned | 2024-11-19T08:26:28+00:00 |
| URL | https://winebid.com/robots.txt |
| Redirect | https://www.winebid.com/robots.txt |
| Redirect Domain | www.winebid.com |
| Redirect Base | winebid.com |
| Domain IPs | 13.107.246.59 |
| Redirect IPs | 13.107.246.59, 2620:1ec:bdf::59 |
| Response IP | 13.107.246.59 |
| Found | Yes |
| Hash | 4f13b0be71210b2b9b68f24601d5bd80c589d0d9b890e640309e8c6dc0aba1b2 |
| SimHash | 637c5b1814a7 |
Groups
googlebot
slurp
teoma
msnbot
yandex
baiduspider
pingdom
ia_archiver
powermapper
twitterbot
facebookexternalhit
pinterest
linkedinbot
bingpreview
duckduckgo
| Rule | Path |
|---|---|
| Disallow | /SignIn |
| Disallow | /Registration |
| Disallow | /Account |
| Disallow | /Cellar/ |
| Allow | /CellarIntro |
| Disallow | /Sales |
| Disallow | /Bids |
| Disallow | /Cart |
| Disallow | /AuctionClosed |
| Disallow | /Search/ViewSameAppellationAndVintage/ |
| Disallow | /Search/ViewSameAppellationAndType/ |
| Disallow | /ModifyLotTracker |
| Disallow | /SwitchLanguage |
| Disallow | /BuyWine/Cart/ |
| Disallow | /ViewMatchingItems/ |
| Disallow | /Help/ShippingHelp/GetRates |
| Disallow | /BuyWine/Vintage/ |
| Disallow | /AdvancedSearch |
| Disallow | /*.asp$ |
| Disallow | /*.asp?* |
| Disallow | /*.aspx$ |
| Disallow | /*.aspx?* |
| Disallow | /*.ashx$ |
| Disallow | /*.ashx?* |
| Disallow | /*.htm$ |
| Disallow | /*.htm?* |
| Disallow | /*.html$ |
| Disallow | /*.html?* |
| Disallow | /*.shtml$ |
| Disallow | /*.shtml?* |
| Disallow | /*.swf$ |
| Disallow | /*.swf?* |
| Disallow | */Price/Ascending |
| Disallow | */Price/Descending |
| Disallow | */SalesRank/Ascending |
| Disallow | */SalesRank/Descending |
| Disallow | */Vintage/Ascending |
| Disallow | */Vintage/Descending |
| Disallow | */Rating/Ascending |
| Disallow | */Rating/Descending |
| Disallow | */Size/Ascending |
| Disallow | */Size/Descending |
| Disallow | */Wine/Ascending |
| Disallow | */Wine/Descending |
| Disallow | */Quantity/Ascending |
| Disallow | */Quantity/Descending |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.winebid.com/api/sitemap/index.xml |
Comments