bproperty.com
robots.txt
Robots Exclusion Standard data for bproperty.com
Resource Scan
Scan Details
| Site Domain | bproperty.com |
| Base Domain | bproperty.com |
| Scan Status | Ok |
| Last Scan | 2024-07-02T21:06:40+00:00 |
| Next Scan | 2024-07-09T21:06:40+00:00 |
Last Scan
| Scanned | 2024-07-02T21:06:40+00:00 |
| URL | https://bproperty.com/robots.txt |
| Redirect | https://www.bproperty.com/robots.txt |
| Redirect Domain | www.bproperty.com |
| Redirect Base | bproperty.com |
| Domain IPs | 18.155.68.35, 18.155.68.36, 18.155.68.45, 18.155.68.63 |
| Redirect IPs | 54.192.18.106, 54.192.18.74, 54.192.18.77, 54.192.18.81 |
| Response IP | 13.33.88.34 |
| Found | Yes |
| Hash | 46aa95340efb50e88262e3d558019655e7dd6a9eb0a69c212b35342bca78ec74 |
| SimHash | 89297c0081f2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /stats/ |
| Disallow | /adserver/ |
| Disallow | /cp/ |
| Disallow | /listings/ |
| Disallow | /mybproperty |
| Disallow | /rehab |
| Disallow | /xml |
| Disallow | /deal_of_the_week/ |
| Disallow | /en/deal_of_the_week/ |
| Disallow | /bn/deal_of_the_week/ |
| Disallow | /featuredAgencies |
| Disallow | /en/featuredAgencies |
| Disallow | /bn/featuredAgencies |
| Disallow | /api/ |
| Disallow | /recommended_properties* |
| Disallow | /profolio/ |
| Disallow | /en/profolio/ |
| Disallow | /bn/profolio/ |
| Disallow | /cp/ |
| Disallow | /en/cp/ |
| Disallow | /bn/cp/ |
| Disallow | /nova/ |
| Disallow | /en/nova/ |
| Disallow | /bn/nova/ |
| Disallow | /en/stats/ |
| Disallow | /bn/stats/ |
| Disallow | /account |
| Disallow | /bn/account |
| Disallow | /captchaChallenge |
| Disallow | /bn/captchaChallenge |
| Disallow | *load_all_prop* |
| Disallow | /blog/wp-admin/ |
| Disallow | /blog/wp-json/ |
facebookexternalhit/1.1
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
Warnings
- 2 invalid lines.