groups.commonfloor.com
robots.txt
Robots Exclusion Standard data for groups.commonfloor.com
Resource Scan
Scan Details
Site Domain | groups.commonfloor.com |
Base Domain | commonfloor.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-07-23T18:59:36+00:00 |
Next Scan | 2025-10-21T18:59:36+00:00 |
Last Successful Scan
Scanned | 2025-03-26T04:44:05+00:00 |
URL | https://groups.commonfloor.com/robots.txt |
Domain IPs | 23.36.49.238 |
Response IP | 23.54.58.82 |
Found | Yes |
Hash | 7a00e43c76af0040b49b6a4cebad422b5dc9a026d61c08538e0087f7294e47ab |
SimHash | 92ff8d0583b3 |
Groups
*
Rule | Path |
---|---|
Disallow | /6225870/ |
Disallow | /_s/ |
Disallow | /sms-service* |
Disallow | /apartments-for-sale?search_intent* |
Disallow | /apartments-for-rent?search_intent* |
Disallow | /index/search* |
Disallow | /for_sale* |
Disallow | /for_rent* |
Disallow | /property-search* |
Disallow | /listing-search* |
Disallow | /project-search* |
Disallow | /sem* |
Disallow | /weekend-guide* |
Disallow | /channel* |
Disallow | /agent/*/cfap-*/listings-sale |
Disallow | /agent/*/cfap-*/listings-rent |
Disallow | /location-listing/* |
Disallow | /property-listing-public/* |
Disallow | /authorize/ |
Disallow | /freetext-search?* |
Disallow | /search?* |
Other Records
Field | Value |
---|---|
sitemap | /sitemap/sitemap_index.xml |