mygoodreal.net
robots.txt
Robots Exclusion Standard data for mygoodreal.net
Resource Scan
Scan Details
| Site Domain | mygoodreal.net |
| Base Domain | mygoodreal.net |
| Scan Status | Ok |
| Last Scan | 2024-09-30T00:00:29+00:00 |
| Next Scan | 2024-10-30T00:00:29+00:00 |
Last Scan
| Scanned | 2024-09-30T00:00:29+00:00 |
| URL | https://www.mygoodreal.net/robots.txt |
| Domain IPs | 3.96.254.126, 52.60.127.178 |
| Response IP | 3.96.254.126 |
| Found | Yes |
| Hash | a0633f1a56225a9d43694e801563d5b45fb28b0fcab85cb306f3f23d65d82ad8 |
| SimHash | 505c4832e2ae |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /default/ |
| Disallow | /js/ |
| Disallow | /api/ |
| Disallow | /iframeApi/ |
| Disallow | /*/common/lang/ |
| Disallow | /*/iframe_short/ |
| Disallow | /*/subscribe/ |
| Disallow | /*/buyingSuccess |
| Disallow | /*/iframe/verifySuccess |
| Disallow | /*/iframeblogList/detail/ |
| Disallow | /*/residential/all/detail/ |
| Disallow | /*/commercial/all/detail/ |
| Disallow | /*/residential/wish/detail/ |
| Disallow | /*/commercial/wish/detail/ |
| Disallow | /*/residential_mls/detail/ |
| Disallow | /*/commercial_mls/detail/ |
| Disallow | /*/residential_mls_wish/detail/ |
| Disallow | /*/commercial_mls_wish/detail/ |
| Disallow | /*/commercial/office/detail/ |
| Disallow | /*/residential_exclusive/detail/ |
| Disallow | /*/commercial_exclusive/detail/ |
| Disallow | /*/residential/detail/ |
| Disallow | /*/commercial/detail/ |
| Disallow | /*/commercial_wish/detail/ |
| Disallow | /*/residential/all-mls-listings/detail/ |
| Disallow | /*/commercial/all-mls-listings/detail/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Warnings
- `request-rate` is not a known field.