doorstead.com
robots.txt
Robots Exclusion Standard data for doorstead.com
Resource Scan
Scan Details
Site Domain | doorstead.com |
Base Domain | doorstead.com |
Scan Status | Ok |
Last Scan | 2024-08-26T15:16:51+00:00 |
Next Scan | 2024-09-25T15:16:51+00:00 |
Last Scan
Scanned | 2024-08-26T15:16:51+00:00 |
URL | https://doorstead.com/robots.txt |
Redirect | https://www.doorstead.com/robots.txt |
Redirect Domain | www.doorstead.com |
Redirect Base | doorstead.com |
Domain IPs | 104.26.0.65, 104.26.1.65, 172.67.72.116, 2606:4700:20::681a:141, 2606:4700:20::681a:41, 2606:4700:20::ac43:4874 |
Redirect IPs | 104.26.0.65, 104.26.1.65, 172.67.72.116, 2606:4700:20::681a:141, 2606:4700:20::681a:41, 2606:4700:20::ac43:4874 |
Response IP | 104.26.0.65 |
Found | Yes |
Hash | fc460bf4ab3fb6b9012ac10a997f384d14f871d3cc1f5c1a8856049d21fd7eb5 |
SimHash | d10358936725 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /old-home |
Disallow | /estimate |
Disallow | /get500 |
Disallow | /guarantee |
Disallow | /intro |
Disallow | /important-disclaimer |
Disallow | /contract |
Disallow | /offer-feedback |
Disallow | /new-offer |
Disallow | /privacy-policy |
Disallow | /san-francisco-bay-area |
Disallow | /san-francisco-bay-area-v2 |
Disallow | /southern-california-property-management |
Disallow | /southern-california-property-management-e |
Disallow | /traditional |
Disallow | /address-entry |
Disallow | /index2 |
Disallow | /drafts/ |
Disallow | /guides/ |
Disallow | /*.pdf$ |
Other Records
Field | Value |
---|---|
sitemap | https://www.doorstead.com/sitemap.xml |
Comments