williampitt.com
robots.txt
Robots Exclusion Standard data for williampitt.com
Resource Scan
Scan Details
| Site Domain | williampitt.com |
| Base Domain | williampitt.com |
| Scan Status | Ok |
| Last Scan | 2026-01-22T08:58:19+00:00 |
| Next Scan | 2026-02-21T08:58:19+00:00 |
Last Scan
| Scanned | 2026-01-22T08:58:19+00:00 |
| URL | https://williampitt.com/robots.txt |
| Redirect | https://www.williampitt.com/robots.txt |
| Redirect Domain | www.williampitt.com |
| Redirect Base | williampitt.com |
| Domain IPs | 104.18.30.89, 104.18.31.89 |
| Redirect IPs | 104.18.30.89, 104.18.31.89 |
| Response IP | 104.18.31.89 |
| Found | Yes |
| Hash | 5d39dab144c502abec414fdb0c1b82ae905d1ce66fcf01d2408a6a16c8372a25 |
| SimHash | 0c308ac421d3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /de/ |
| Disallow | /el/ |
| Disallow | /es/ |
| Disallow | /fr/ |
| Disallow | /it/ |
| Disallow | /ja/ |
| Disallow | /ko/ |
| Disallow | /nl/ |
| Disallow | /pb/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /sv/ |
| Disallow | /tr/ |
| Disallow | /tw/ |
| Disallow | /vi/ |
| Disallow | /zh/ |
| Disallow | */print/* |
| Disallow | *saveprop |
| Disallow | /mylogin |
| Disallow | *mylogin/* |
| Disallow | */mylogin/* |
| Disallow | *mortgage-calculator* |
| Disallow | *send-to-phone* |
| Disallow | /agents/*/search/ |
| Disallow | /agents/*/about/ |
| Disallow | /agents/*/search/real-estate-sales/ |
| Disallow | /search/real-estate-sales/?min_price |
| Disallow | /search/real-estate-sales/?waterfront_desc |
| Disallow | /agents/*/communities/ |
| Disallow | /market-report?print=1 |
| Disallow | *props?lat%21lon= |
| Disallow | /mylogin/saveprop |
| Disallow | /mylogin/saveprop/ |
| Disallow | /bbc/*.pdf |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.williampitt.com/sitemap_index.xml |