selectsothebysrealty.com
robots.txt
Robots Exclusion Standard data for selectsothebysrealty.com
Resource Scan
Scan Details
| Site Domain | selectsothebysrealty.com |
| Base Domain | selectsothebysrealty.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-28T20:47:46+00:00 |
| Next Scan | 2024-12-27T20:47:46+00:00 |
Last Successful Scan
| Scanned | 2023-02-14T10:10:47+00:00 |
| URL | https://selectsothebysrealty.com/robots.txt |
| Redirect | https://www.selectsothebysrealty.com:443/robots.txt |
| Redirect Domain | www.selectsothebysrealty.com |
| Redirect Base | selectsothebysrealty.com |
| Domain IPs | 75.2.22.66, 99.83.177.174 |
| Redirect IPs | 75.2.22.66, 99.83.177.174 |
| Response IP | 75.2.22.66 |
| Found | Yes |
| Hash | 89a7e38136bb24c7cab7c60a4e085dbe1f7e64c6994a3b029225caba0727dd6a |
| SimHash | cadf8b7fc0b6 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */gallery-view* |
| Disallow | */list-view* |
| Disallow | */map-view* |
| Disallow | */schools* |
| Disallow | */reno/search* |
| Disallow | *brochure* |
| Disallow | */brokersprint* |
| Disallow | /spu/tag/* |
| Disallow | /spa/tag/* |
| Disallow | /deu/tag/* |
| Disallow | /frc/tag/* |
| Disallow | /fra/tag/* |
| Disallow | /ita/tag/* |
| Disallow | /jpn/tag/* |
| Disallow | /pob/tag/* |
| Disallow | /por/tag/* |
| Disallow | /rus/tag/* |
| Disallow | /zhs/tag/* |
| Disallow | /zht/tag/* |
| Disallow | /vie/tag/* |
| Disallow | /kor/tag/* |
| Disallow | /tur/tag/* |
| Disallow | /nld/tag/* |
| Disallow | /swe/tag/* |
| Disallow | /ell/tag/* |
| Disallow | /spu/article/* |
| Disallow | /spa/article/* |
| Disallow | /deu/article/* |
| Disallow | /frc/article/* |
| Disallow | /fra/article/* |
| Disallow | /ita/article/* |
| Disallow | /jpn/article/* |
| Disallow | /pob/article/* |
| Disallow | /por/article/* |
| Disallow | /rus/article/* |
| Disallow | /zhs/article/* |
| Disallow | /zht/article/* |
| Disallow | /vie/article/* |
| Disallow | /kor/article/* |
| Disallow | /tur/article/* |
| Disallow | /nld/article/* |
| Disallow | /swe/article/* |
| Disallow | /ell/article/* |
| Disallow | /spu/category/* |
| Disallow | /spa/category/* |
| Disallow | /deu/category/* |
| Disallow | /frc/category/* |
| Disallow | /fra/category/* |
| Disallow | /ita/category/* |
| Disallow | /jpn/category/* |
| Disallow | /pob/category/* |
| Disallow | /por/category/* |
| Disallow | /rus/category/* |
| Disallow | /zhs/category/* |
| Disallow | /zht/category/* |
| Disallow | /vie/category/* |
| Disallow | /kor/category/* |
| Disallow | /tur/category/* |
| Disallow | /nld/category/* |
| Disallow | /swe/category/* |
| Disallow | /ell/category/* |
| Disallow | /*-agentid$ |
| Disallow | /*-baths$ |
| Disallow | /*-beds$ |
| Disallow | /*-map$ |
| Disallow | /*-pp$ |
| Disallow | /*-price$ |
| Disallow | /*-sort$ |
| Disallow | /*-sqft$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
baiduspider-render
| Rule | Path |
|---|---|
| Disallow | /ara* |
| Disallow | /deu* |
| Disallow | /ell* |
| Disallow | /enb* |
| Disallow | /fra* |
| Disallow | /frc* |
| Disallow | /ita* |
| Disallow | /jpn* |
| Disallow | /kor* |
| Disallow | /nld* |
| Disallow | /pob* |
| Disallow | /por* |
| Disallow | /rus* |
| Disallow | /spa* |
| Disallow | /spu* |
| Disallow | /swe* |
| Disallow | /tur* |
| Disallow | /vie* |
baiduspider
| Rule | Path |
|---|---|
| Disallow | /ara* |
| Disallow | /deu* |
| Disallow | /ell* |
| Disallow | /enb* |
| Disallow | /fra* |
| Disallow | /frc* |
| Disallow | /ita* |
| Disallow | /jpn* |
| Disallow | /kor* |
| Disallow | /nld* |
| Disallow | /pob* |
| Disallow | /por* |
| Disallow | /rus* |
| Disallow | /spa* |
| Disallow | /spu* |
| Disallow | /swe* |
| Disallow | /tur* |
| Disallow | /vie* |
yandex
| Rule | Path |
|---|---|
| Disallow | /ara* |
| Disallow | /deu* |
| Disallow | /ell* |
| Disallow | /enb* |
| Disallow | /eng* |
| Disallow | /fra* |
| Disallow | /frc* |
| Disallow | /ita* |
| Disallow | /jpn* |
| Disallow | /kor* |
| Disallow | /nld* |
| Disallow | /pob* |
| Disallow | /por* |
| Disallow | /spa* |
| Disallow | /spu* |
| Disallow | /swe* |
| Disallow | /vie* |
| Disallow | /zhs* |
| Disallow | /zht* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://selectsothebysrealty.com/sitemap.xml |
Comments