housing.com
robots.txt
Robots Exclusion Standard data for housing.com
Resource Scan
Scan Details
| Site Domain | housing.com |
| Base Domain | housing.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-21T13:54:25+00:00 |
| Next Scan | 2024-10-05T13:54:25+00:00 |
Last Successful Scan
| Scanned | 2024-06-26T12:48:56+00:00 |
| URL | https://housing.com/robots.txt |
| Domain IPs | 2606:4700::6811:41ef, 2606:4700::6811:42ef, 52.84.229.55, 52.84.229.62, 52.84.229.72, 52.84.229.76 |
| Response IP | 52.84.229.76 |
| Found | Yes |
| Hash | fc3b6392628c31fe1e77f3b84e2e0be82f01c6ed5c91e01f7f8e1b78b75d28f0 |
| SimHash | f68529ad60f4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/*/search* |
| Disallow | /agents/tiles* |
| Disallow | /rent/search-* |
| Disallow | /paying-guests/search-* |
| Disallow | /in/buy/agent/* |
| Disallow | /agents/search-* |
| Disallow | /international/* |
| Disallow | /my-listings/* |
| Disallow | /external-ads/* |
| Disallow | /store/* |
| Disallow | /in/home-loans/check-eligibility/customize-offers* |
| Disallow | /developer/* |
| Disallow | /webAnalytics* |
| Disallow | /paying-guests/pgs-in-* |
| Disallow | /rent/recommendations/* |
| Disallow | /in/buy/recommendations/* |
| Disallow | /rent/shortlist* |
| Disallow | /buy/shortlist* |
| Disallow | /rent/recommended* |
| Disallow | /buy/recommended* |
| Disallow | /user-profile* |
| Disallow | /profile* |
| Disallow | /emailer/* |
| Disallow | /microsite/* |
| Disallow | /mr/* |
| Disallow | /ta/* |
| Disallow | /te/* |
| Disallow | /kn/* |
| Disallow | /bn/* |
| Disallow | /test-hi/* |
| Disallow | /news/home-loan/* |
| Disallow | /in/buy/plots* |
| Disallow | /buy/collections-* |
| Disallow | /rent/collections-* |
| Disallow | /edge/home-inspection* |
| Disallow | /edge/rental-furniture* |
| Disallow | /edge/legal-services* |
| Disallow | /review/* |
| Disallow | /new-reco/* |
| Disallow | /buy-property-by-* |
| Disallow | /community* |
| Disallow | /*-overview-*/reviews |
Comments