shared.sothebys.com
robots.txt
Robots Exclusion Standard data for shared.sothebys.com
Resource Scan
Scan Details
| Site Domain | shared.sothebys.com |
| Base Domain | sothebys.com |
| Scan Status | Ok |
| Last Scan | 2024-09-24T20:29:25+00:00 |
| Next Scan | 2024-10-24T20:29:25+00:00 |
Last Scan
| Scanned | 2024-09-24T20:29:25+00:00 |
| URL | https://shared.sothebys.com/robots.txt |
| Domain IPs | 54.160.241.162, 54.174.19.82 |
| Response IP | 54.160.241.162 |
| Found | Yes |
| Hash | bbb46f8b19b1fc9492a8793fd0d63fa0dfbff5237285194a0253c0ed88e6f0c2 |
| SimHash | 6800dac5c3d1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /pdf/ |
| Disallow | /*results.sale.pdf/ |
| Disallow | /*/auctions/ecatalogue/lot.pdf |
| Disallow | /*/PDFs/ |
| Disallow | /minisite/pdf |
| Disallow | /*/pdf/index.html |
| Disallow | /content/dam/sothebys/InsideSothebys*.pdf |
| Disallow | /styleguide/* |
| Disallow | /bsp-api/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
googlebot
| Rule | Path |
|---|---|
| Disallow | /pdf/ |
| Disallow | /*results.sale.pdf/ |
| Disallow | /*/auctions/ecatalogue/lot.pdf |
| Disallow | /*/PDFs/ |
| Disallow | /minisite/pdf |
| Disallow | /*/pdf/index.html |
| Disallow | /content/dam/sothebys/InsideSothebys*.pdf |
| Disallow | /bsp-api/* |
bingbot
| Rule | Path |
|---|---|
| Disallow | /pdf/ |
| Disallow | /*results.sale.pdf/ |
| Disallow | /*/auctions/ecatalogue/lot.pdf |
| Disallow | /*/PDFs/ |
| Disallow | /minisite/pdf |
| Disallow | /*/pdf/index.html |
| Disallow | /content/dam/sothebys/InsideSothebys*.pdf |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
yandex
| Rule | Path |
|---|---|
| Disallow | /pdf/ |
| Disallow | /*results.sale.pdf/ |
| Disallow | /*/auctions/ecatalogue/lot.pdf |
| Disallow | /*/PDFs/ |
| Disallow | /minisite/pdf |
| Disallow | /*/pdf/index.html |
| Disallow | /content/dam/sothebys/InsideSothebys*.pdf |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.sothebys.com/sitemap.xml |
Warnings
- `noindex` is not a known field.
Comments