sir.com
robots.txt
Robots Exclusion Standard data for sir.com
Resource Scan
Scan Details
| Site Domain | sir.com |
| Base Domain | sir.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-15T07:20:18+00:00 |
| Next Scan | 2024-07-14T07:20:18+00:00 |
Last Successful Scan
| Scanned | 2024-02-23T07:19:04+00:00 |
| URL | https://sir.com/robots.txt |
| Redirect | https://www.sothebysrealty.com:443/robots.txt |
| Redirect Domain | www.sothebysrealty.com |
| Redirect Base | sothebysrealty.com |
| Domain IPs | 75.2.119.66, 99.83.149.189 |
| Redirect IPs | 75.2.119.66, 99.83.149.189 |
| Response IP | 75.2.119.66 |
| Found | Yes |
| Hash | 9687cf8c6b1b279b09e7c5cb3e83c65767cceebca3dc55732259a975e8ef7a44 |
| SimHash | e443e159487b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */gallery-view* |
| Disallow | */schools* |
| Disallow | */reno/search* |
| Disallow | *brochure* |
| Disallow | */brokersprint* |
| Disallow | */propertycarousel-tab |
| Disallow | */doreport.ashx |
| Disallow | /*-keyword |
| Disallow | /ara* |
| Disallow | /ell* |
| Disallow | /enb* |
| Disallow | /nld* |
| Disallow | /swe* |
| Disallow | *%25 |
| Disallow | *%7B |
| Disallow | *%7D |
| Disallow | *%3A |
| Disallow | *%7B |
| Disallow | *%7D |
| Disallow | /*-agentid$ |
| Disallow | /*-baths$ |
| Disallow | /*-beds$ |
| Disallow | /*-map$ |
| Disallow | /*-pp$ |
| Disallow | /*-price$ |
| Disallow | /*-sort$ |
| Disallow | /*-sqft$ |
| Disallow | /deu/vertrieb/* |
| Disallow | /fra/ventes/* |
| Disallow | /frc/ventes/* |
| Disallow | /ita/vendite/* |
| Disallow | /jpn/sales/* |
| Disallow | /kor/sales/* |
| Disallow | /pob/de-vendas/* |
| Disallow | /por/vendas/* |
| Disallow | /rus/sales/* |
| Disallow | /spa/venta/* |
| Disallow | /spu/venta/* |
| Disallow | /tur/satis/* |
| Disallow | /vie/ban-hang/* |
| Disallow | /zhs/sales/* |
| Disallow | /zht/sales/* |
| Disallow | /deu/vermietungen/* |
| Disallow | /fra/locations/* |
| Disallow | /frc/locations/* |
| Disallow | /ita/affitti/* |
| Disallow | /jpn/rentals/* |
| Disallow | /kor/rentals/* |
| Disallow | /pob/para-alugar/* |
| Disallow | /por/arrendamentos/* |
| Disallow | /rus/rentals/* |
| Disallow | /spa/alquiler/* |
| Disallow | /spu/alquiler/* |
| Disallow | /tur/kiralama/* |
| Disallow | /vie/dich-vu-cho-thue/* |
| Disallow | /zhs/rentals/* |
| Disallow | /zht/rentals/* |
| Disallow | /deu/associate* |
| Disallow | /fra/associate* |
| Disallow | /frc/associate* |
| Disallow | /ita/associate* |
| Disallow | /jpn/associate* |
| Disallow | /kor/associate* |
| Disallow | /pob/associate* |
| Disallow | /por/associate* |
| Disallow | /rus/associate* |
| Disallow | /spa/associate* |
| Disallow | /spu/associate* |
| Disallow | /tur/associate* |
| Disallow | /vie/associate* |
| Disallow | /zhs/associate* |
| Disallow | /zht/associate* |
| Disallow | /deu/verkauft/detail/* |
| Disallow | /fra/vendu/detail/* |
| Disallow | /frc/vendu/detail/* |
| Disallow | /ita/venduto/dettaglio/* |
| Disallow | /jpn/sold/detail/* |
| Disallow | /kor/sold/detail/* |
| Disallow | /pob/vendido/detalhe/* |
| Disallow | /por/vendido/detalhe/* |
| Disallow | /rus/sold/detail/* |
| Disallow | /spa/vendido/detalle/* |
| Disallow | /spu/vendido/detalle/* |
| Disallow | /tur/satilan/detay/* |
| Disallow | /vie/ban/chi-tiet/* |
| Disallow | /zhs/sold/detail/* |
| Disallow | /zht/sold/detail/* |
| Disallow | /*-loc |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
baiduspider-render
| Rule | Path |
|---|---|
| Disallow | /ara* |
| Disallow | /deu* |
| Disallow | /ell* |
| Disallow | /enb* |
| Disallow | /fra* |
| Disallow | /frc* |
| Disallow | /ita* |
| Disallow | /jpn* |
| Disallow | /kor* |
| Disallow | /nld* |
| Disallow | /pob* |
| Disallow | /por* |
| Disallow | /rus* |
| Disallow | /spa* |
| Disallow | /spu* |
| Disallow | /swe* |
| Disallow | /tur* |
| Disallow | /vie* |
| Disallow | *%7B |
| Disallow | *%7D |
| Disallow | *%7B |
| Disallow | *%7D |
| Disallow | *%25 |
| Disallow | *%3A |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
baiduspider
| Rule | Path |
|---|---|
| Disallow | /ara* |
| Disallow | /deu* |
| Disallow | /ell* |
| Disallow | /enb* |
| Disallow | /fra* |
| Disallow | /frc* |
| Disallow | /ita* |
| Disallow | /jpn* |
| Disallow | /kor* |
| Disallow | /nld* |
| Disallow | /pob* |
| Disallow | /por* |
| Disallow | /rus* |
| Disallow | /spa* |
| Disallow | /spu* |
| Disallow | /swe* |
| Disallow | /tur* |
| Disallow | /vie* |
| Disallow | *%7B |
| Disallow | *%7D |
| Disallow | *%7B |
| Disallow | *%7D |
| Disallow | *%25 |
| Disallow | *%3A |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
slurp
| Rule | Path |
|---|---|
| Disallow | */schools* |
| Disallow | /zhs* |
| Disallow | /zht* |
| Disallow | /deu* |
| Disallow | /pob* |
| Disallow | /rus* |
| Disallow | /vie* |
| Disallow | /kor* |
| Disallow | /tur* |
| Disallow | /enb* |
| Disallow | /nld* |
| Disallow | /swe* |
| Disallow | /ell* |
| Disallow | */reno/search* |
| Disallow | *brochure* |
| Disallow | */brokersprint* |
| Disallow | */propertycarousel-tab |
| Disallow | */doreport.ashx |
| Disallow | *%7B |
| Disallow | *%7D |
| Disallow | *%7B |
| Disallow | *%7D |
| Disallow | *%25 |
| Disallow | *%3A |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
yandex
| Rule | Path |
|---|---|
| Disallow | */schools* |
| Disallow | /spu* |
| Disallow | /spa* |
| Disallow | /zhs* |
| Disallow | /zht* |
| Disallow | /deu* |
| Disallow | /frc* |
| Disallow | /fra* |
| Disallow | /ita* |
| Disallow | /jpn* |
| Disallow | /pob* |
| Disallow | /por* |
| Disallow | /vie* |
| Disallow | /kor* |
| Disallow | /tur* |
| Disallow | /enb* |
| Disallow | /nld* |
| Disallow | /swe* |
| Disallow | /ell* |
| Disallow | */reno/search* |
| Disallow | *brochure* |
| Disallow | */brokersprint* |
| Disallow | */propertycarousel-tab |
| Disallow | */doreport.ashx |
| Disallow | *%7B |
| Disallow | *%7D |
| Disallow | *%7B |
| Disallow | *%7D |
| Disallow | *%25 |
| Disallow | *%3A |
| Disallow | /developments/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.sothebysrealty.com/sitemap.xml |
Warnings
- 10 invalid lines.