Log In Sign Up

dreamhost.com
robots.txt

Robots Exclusion Standard data for dreamhost.com

Resource Scan

Scan Details

Site Domain dreamhost.com
Base Domain dreamhost.com
Scan Status Ok
Last Scan2024-11-05T07:23:43+00:00
Next Scan 2024-11-19T07:23:43+00:00

Last Scan

Scanned2024-11-05T07:23:43+00:00
URL https://dreamhost.com/robots.txt
Redirect https://www.dreamhost.com/robots.txt
Redirect Domain www.dreamhost.com
Redirect Base dreamhost.com
Domain IPs 18.238.238.11, 18.238.238.118, 18.238.238.61, 18.238.238.97, 2600:9000:2784:1000:1d:5c4:5c40:93a1, 2600:9000:2784:1400:1d:5c4:5c40:93a1, 2600:9000:2784:2a00:1d:5c4:5c40:93a1, 2600:9000:2784:4600:1d:5c4:5c40:93a1, 2600:9000:2784:4c00:1d:5c4:5c40:93a1, 2600:9000:2784:7000:1d:5c4:5c40:93a1, 2600:9000:2784:9400:1d:5c4:5c40:93a1, 2600:9000:2784:ea00:1d:5c4:5c40:93a1
Redirect IPs 108.157.254.109, 108.157.254.116, 108.157.254.17, 108.157.254.35, 2600:9000:2753:3200:1a:6c26:bb80:93a1, 2600:9000:2753:5400:1a:6c26:bb80:93a1, 2600:9000:2753:6400:1a:6c26:bb80:93a1, 2600:9000:2753:7a00:1a:6c26:bb80:93a1, 2600:9000:2753:c00:1a:6c26:bb80:93a1, 2600:9000:2753:e600:1a:6c26:bb80:93a1, 2600:9000:2753:f000:1a:6c26:bb80:93a1, 2600:9000:2753:fa00:1a:6c26:bb80:93a1
Response IP 108.157.254.109
Found Yes
Hash fb50959918a5959bb16a214d0f708d67cc7452000ca146cad8c856d3c1d79925
SimHash 63912cc5eb99

Groups

*

Rule Path
Disallow /legal/former-affiliate-terms-and-conditions/
Disallow /flash-sale-50/
Disallow /newyears-2020-aff/
Disallow /pro-services/management/site-update/php/
Disallow /flash-sale-60/
Disallow /legal/terms-of-service/unstyled.html
Disallow /downloads/
Disallow /abuse.asc
Disallow /website-builder/
Disallow /website-builder/themes/
Back to top

Other Records

Field Value
sitemap https://www.dreamhost.com/sitemap-index.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top