streeteasy.com
robots.txt
Robots Exclusion Standard data for streeteasy.com
Resource Scan
Scan Details
| Site Domain | streeteasy.com |
| Base Domain | streeteasy.com |
| Scan Status | Ok |
| Last Scan | 2024-06-15T14:39:31+00:00 |
| Next Scan | 2024-06-22T14:39:31+00:00 |
Last Scan
| Scanned | 2024-06-15T14:39:31+00:00 |
| URL | https://streeteasy.com/robots.txt |
| Domain IPs | 18.244.214.101, 18.244.214.128, 18.244.214.48, 18.244.214.83 |
| Response IP | 3.160.246.103 |
| Found | Yes |
| Hash | e3ce18f57cfa47e2acbff3e94505a243627f2daa29d3ffba78c0d200cc9d0c60 |
| SimHash | ea92e5f04373 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /building/*/documents |
| Disallow | /sale/* |
| Disallow | /rental/* |
| Disallow | /building/*/floorplans |
| Disallow | */messages/new |
| Disallow | */premier_agents/new |
| Disallow | */property/index/ |
| Disallow | */saved_open_houses/ |
| Disallow | */comparables_reports/ |
| Disallow | */building_experts_component |
| Disallow | /nyc/api |
| Disallow | */visit?* |
| Disallow | */admin |
| Disallow | */my/* |
| Disallow | */rss |
| Disallow | */sales/rss |
| Disallow | */rentals/rss |
| Disallow | */process |
| Disallow | */saved_items |
| Disallow | */folders |
| Disallow | */edit_search |
| Disallow | */user/* |
| Disallow | */talk/new_discussion* |
| Disallow | */school/*/email |
| Disallow | */manage |
| Allow | */manage/list_your_rental |
| Allow | */manage/list_your_sale |
| Disallow | */feedback/* |
| Allow | */feedback/individual_unit_owner |
| Allow | */feedback/submit_your_listings |
Other Records
| Field | Value |
|---|---|
| sitemap | https://streeteasy.com/sitemaps/secure/nyc_sitemap_index.xml |
| sitemap | https://streeteasy.com/blog/sitemap_index.xml |
| sitemap | https://streeteasy.com/neighborhoods/sitemap_index.xml |
| sitemap | https://streeteasy.com/agent-resources/sitemap_index.xml |
| sitemap | https://streeteasy.com/guides/sitemap_index.xml |
Comments