tollbrothers.com
robots.txt
Robots Exclusion Standard data for tollbrothers.com
Resource Scan
Scan Details
| Site Domain | tollbrothers.com |
| Base Domain | tollbrothers.com |
| Scan Status | Ok |
| Last Scan | 2024-04-25T11:53:56+00:00 |
| Next Scan | 2024-05-25T11:53:56+00:00 |
Last Scan
| Scanned | 2024-04-25T11:53:56+00:00 |
| URL | https://tollbrothers.com/robots.txt |
| Redirect | https://www.tollbrothers.com/robots.txt |
| Redirect Domain | www.tollbrothers.com |
| Redirect Base | tollbrothers.com |
| Domain IPs | 44.198.206.148, 52.1.212.14, 52.73.104.177, 54.81.178.248 |
| Redirect IPs | 108.157.254.12, 108.157.254.21, 108.157.254.57, 108.157.254.64, 2600:9000:2753:4c00:11:7939:2940:93a1, 2600:9000:2753:7000:11:7939:2940:93a1, 2600:9000:2753:9000:11:7939:2940:93a1, 2600:9000:2753:9a00:11:7939:2940:93a1, 2600:9000:2753:9e00:11:7939:2940:93a1, 2600:9000:2753:b400:11:7939:2940:93a1, 2600:9000:2753:c000:11:7939:2940:93a1, 2600:9000:2753:c600:11:7939:2940:93a1 |
| Response IP | 108.157.254.21 |
| Found | Yes |
| Hash | 70bf2c21595be29a660b0b96e72db5c88ed5e07979b51b321fff181122d2353b |
| SimHash | 4b0ef9644313 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /about/your-story |
| Disallow | /about/your-story?* |
| Disallow | /agent/rest/add/user/connect |
| Disallow | /agent/rest/add/user/new |
| Disallow | /agent/rest/login |
| Disallow | /best-offer/thank-you |
| Disallow | /best-offer/thank-you.php |
| Disallow | /blog/wp-admin/ |
| Disallow | /cgi-bin/ |
| Disallow | /compare |
| Disallow | /compare?* |
| Disallow | /contact/mortgageSubmit |
| Disallow | /external/ |
| Disallow | /external/* |
| Disallow | /highrise |
| Disallow | /highrise/ |
| Disallow | /highrise/* |
| Disallow | /lead/process |
| Disallow | /luxury-homes/Edgewood-TX |
| Disallow | /luxury-homes/Edgewood-TX?* |
| Disallow | /luxury-homes-for-sale/*/siteplans/* |
| Disallow | /my-favorites/offpagelogin |
| Disallow | /my_favorites/offpagelogin |
| Disallow | /my-favorites/processUnsubscribe |
| Disallow | /my_favorites/processUnsubscribe |
| Disallow | /new-home-journey |
| Disallow | /new-home-journey?* |
| Disallow | /new-homes |
| Disallow | /new-homes?* |
| Disallow | /nse |
| Disallow | /nse?* |
| Disallow | |
| Disallow | /print?* |
| Disallow | /service* |
| Disallow | /sitesearch |
| Disallow | /sitesearch?* |
| Disallow | /survey/ |
| Disallow | /tb/about/index.html |
| Allow | /blog/wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.tollbrothers.com/meta/sitemap.xml |