liveauctioneers.com
robots.txt
Robots Exclusion Standard data for liveauctioneers.com
Resource Scan
Scan Details
| Site Domain | liveauctioneers.com |
| Base Domain | liveauctioneers.com |
| Scan Status | Ok |
| Last Scan | 2024-05-10T22:17:21+00:00 |
| Next Scan | 2024-05-24T22:17:21+00:00 |
Last Scan
| Scanned | 2024-05-10T22:17:21+00:00 |
| URL | https://liveauctioneers.com/robots.txt |
| Redirect | https://www.liveauctioneers.com/robots.txt |
| Redirect Domain | www.liveauctioneers.com |
| Redirect Base | liveauctioneers.com |
| Domain IPs | 204.246.191.62, 204.246.191.82, 204.246.191.93, 204.246.191.97 |
| Redirect IPs | 18.155.68.40, 18.155.68.56, 18.155.68.58, 18.155.68.95 |
| Response IP | 18.155.68.58 |
| Found | Yes |
| Hash | 1235b24cc31591850d3261207de4f624479f386b485f210006123e4cebdb7a7f |
| SimHash | 8d6d94facb32 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search? |
| Disallow | /search/? |
| Disallow | /dashboard/ |
| Disallow | /healthcheck |
| Disallow | /v1/lot |
| Disallow | /item-api/ |
| Disallow | /mainhost-api/ |
| Disallow | /saved-search-api |
| Disallow | /newsletter/ |
| Disallow | /sothebys/item/ |
| Disallow | /bonhams/item/ |
| Disallow | /iphone/ |
| Disallow | /statistics/ |
| Disallow | /auctioneers/ |
| Disallow | /_o/jretradevideo.html |
| Disallow | /jretradevideo.html |
| Disallow | /clientweb/ |
| Disallow | /user/ |
| Disallow | /login/ |
| Disallow | /nlogin/ |
| Disallow | /password_reset/ |
| Disallow | /undefined/ |
| Disallow | /live_design/ |
| Disallow | /bidapplet* |
| Disallow | *country%3D* |
| Disallow | *current_bid%3D* |
| Disallow | *distance%3D* |
| Disallow | *estimated_price%3D* |
| Disallow | *hammer_price%3D* |
| Disallow | *house_id%3D* |
| Disallow | *keyword%3D* |
| Disallow | *sale_type%3D* |
| Disallow | *sort%3D* |
| Disallow | *buyNow%3D* |
| Disallow | *buyNowDate%3D* |
| Disallow | *category_id%3D* |
| Disallow | *classic%3D* |
| Disallow | *pagenum%3D* |
| Disallow | *rows%3D* |
| Disallow | *from%3D* |
| Disallow | *count%3D* |
| Disallow | *sort%3D* |
| Disallow | *filter%3D* |
| Disallow | *terms%3D* |
| Disallow | *url%3D* |
| Disallow | *filterTerm%3D* |
| Allow | /api |
| Allow | *.js |
bingbot
| Rule | Path |
|---|---|
| Disallow | /search? |
| Disallow | /search/? |
| Disallow | /dashboard/ |
| Disallow | /healthcheck |
| Disallow | /v1/lot |
| Disallow | /item-api/ |
| Disallow | /mainhost-api/ |
| Disallow | /saved-search-api |
| Disallow | /newsletter/ |
| Disallow | /sothebys/item/ |
| Disallow | /bonhams/item/ |
| Disallow | /iphone/ |
| Disallow | /statistics/ |
| Disallow | /auctioneers/ |
| Disallow | /_o/jretradevideo.html |
| Disallow | /jretradevideo.html |
| Disallow | /clientweb/ |
| Disallow | /user/ |
| Disallow | /login/ |
| Disallow | /nlogin/ |
| Disallow | /password_reset/ |
| Disallow | /undefined/ |
| Disallow | /live_design/ |
| Disallow | /bidapplet* |
| Disallow | *country%3D* |
| Disallow | *current_bid%3D* |
| Disallow | *distance%3D* |
| Disallow | *estimated_price%3D* |
| Disallow | *hammer_price%3D* |
| Disallow | *house_id%3D* |
| Disallow | *keyword%3D* |
| Disallow | *sale_type%3D* |
| Disallow | *sort%3D* |
| Disallow | *buyNow%3D* |
| Disallow | *buyNowDate%3D* |
| Disallow | *category_id%3D* |
| Disallow | *live%3D* |
| Disallow | *classic%3D* |
| Disallow | *pagenum%3D* |
| Disallow | *rows%3D* |
| Disallow | *from%3D* |
| Disallow | *count%3D* |
| Disallow | *sort%3D* |
| Disallow | *filter%3D* |
| Disallow | *terms%3D* |
| Disallow | *url%3D* |
| Disallow | *filterTerm%3D* |
| Allow | /api |
| Allow | *.js |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.liveauctioneers.com/sitemap-index.xml.gz |
| sitemap | https://www.liveauctioneers.com/price-result-sitemap-index.xml.gz |
Comments