doorstead.com
robots.txt

Robots Exclusion Standard data for doorstead.com

Resource Scan

Scan Details

Site Domain doorstead.com
Base Domain doorstead.com
Scan Status Ok
Last Scan2024-08-26T15:16:51+00:00
Next Scan 2024-09-25T15:16:51+00:00

Last Scan

Scanned2024-08-26T15:16:51+00:00
URL https://doorstead.com/robots.txt
Redirect https://www.doorstead.com/robots.txt
Redirect Domain www.doorstead.com
Redirect Base doorstead.com
Domain IPs 104.26.0.65, 104.26.1.65, 172.67.72.116, 2606:4700:20::681a:141, 2606:4700:20::681a:41, 2606:4700:20::ac43:4874
Redirect IPs 104.26.0.65, 104.26.1.65, 172.67.72.116, 2606:4700:20::681a:141, 2606:4700:20::681a:41, 2606:4700:20::ac43:4874
Response IP 104.26.0.65
Found Yes
Hash fc460bf4ab3fb6b9012ac10a997f384d14f871d3cc1f5c1a8856049d21fd7eb5
SimHash d10358936725

Groups

*

Rule Path
Allow /
Disallow /old-home
Disallow /estimate
Disallow /get500
Disallow /guarantee
Disallow /intro
Disallow /important-disclaimer
Disallow /contract
Disallow /offer-feedback
Disallow /new-offer
Disallow /privacy-policy
Disallow /san-francisco-bay-area
Disallow /san-francisco-bay-area-v2
Disallow /southern-california-property-management
Disallow /southern-california-property-management-e
Disallow /traditional
Disallow /address-entry
Disallow /index2
Disallow /drafts/
Disallow /guides/
Disallow /*.pdf$

Other Records

Field Value
sitemap https://www.doorstead.com/sitemap.xml

Comments

  • Allow everywhere