byowner.com
robots.txt
Robots Exclusion Standard data for byowner.com
Resource Scan
Scan Details
| Site Domain | byowner.com |
| Base Domain | byowner.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-11-08T10:37:36+00:00 |
| Next Scan | 2024-11-15T10:37:36+00:00 |
Last Successful Scan
| Scanned | 2023-09-28T15:57:05+00:00 |
| URL | https://byowner.com/robots.txt |
| Domain IPs | 23.23.121.228 |
| Response IP | 23.23.121.228 |
| Found | Yes |
| Hash | df8b006500286f03f6f389c069464786edd6b01de66fc7763c04b73e987cf819 |
| SimHash | d96e8d118856 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /public/js/ |
| Disallow | /public/styles/ |
| Disallow | /public/images/ |
| Disallow | /public/upload/ |
| Disallow | */htmlcache/ |
| Disallow | /admin/ |
| Disallow | /webmaster/ |
| Disallow | /thumb |
| Disallow | /thumb.php |
| Disallow | /checkresizeimg.php |
| Disallow | /user/myaccount |
| Disallow | /user/yardsign |
| Disallow | /user/accountprofile |
| Disallow | /user/documents |
| Disallow | /user/savedsearches |
| Disallow | /user/* |
| Disallow | /bath%3D* |
| Allow | /bed%3D*/bath%3D |
| Disallow | /vacation-rentals/*/guest%3D* |
| Disallow | */status%3Drented* |
| Disallow | */status%3Dsold* |
| Disallow | */days%3D* |
| Disallow | /user/update_user_property_view_count |
| Disallow | *configclcheck%3D* |
| Disallow | *clquerydebug%3D* |
| Disallow | *flushcache%3D* |
| Disallow | *showqueries%3D* |
| Disallow | *cdnflag%3D* |
| Disallow | *adsdisable%3D* |
| Disallow | *mdb_flag%3D* |
| Disallow | /elasticsearch/* |
| Disallow | /shellscript/* |
| Disallow | /slave_alert.php |
| Disallow | /NS/* |
| Disallow | /WS/* |
| Disallow | /zip-code/* |
| Disallow | /sitemap-xml-for-city-region-for-sale |
| Disallow | /sitemap-xml-for-subdivision-for-sale |
| Disallow | /sitemap-xml-for-zipcode-for-sale |
| Disallow | /sitemap-xml-for-county-region-for-sale |
| Disallow | /sitemap-xml-for-city-region-for-rental |
| Disallow | /sitemap-xml-for-subdivision-for-rental |
| Disallow | /sitemap-xml/listing-type%3D* |
| Disallow | /sitemap-xml/* |
| Disallow | /create-sitemap-for-sale |
| Disallow | /create-sitemap-for-rental |
| Disallow | /sitemap-xml-for-general |
| Disallow | /sitemap-xml-for-city-region-for-openhouse |
| Disallow | /sitemap-xml-for-vr/* |
| Disallow | /sitemap-xml-for-detail/* |
| Disallow | /for-sale-rss.xml |
| Disallow | /vacation-rentals-rss.xml |
| Disallow | /rentals-rss.xml |
| Disallow | */page%3D* |
| Allow | */page%3D1$ |
| Allow | */page%3D2$ |
| Allow | */page%3D3$ |
| Allow | */page%3D4$ |
| Allow | */page%3D5$ |
| Allow | */page%3D6$ |
| Disallow | */blog/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.byowner.com/sitemap.xml |
| sitemap | https://www.byowner.com/cities.xml |
| sitemap | https://www.byowner.com/subdivisions.xml |
| sitemap | https://www.byowner.com/zipcodes.xml |
| sitemap | https://www.byowner.com/vacation_rentals.xml |
| sitemap | https://www.byowner.com/properties.xml |
| sitemap | https://www.byowner.com/vrproperties.xml |