Log In Sign Up

dreamhost.com
robots.txt

Robots Exclusion Standard data for dreamhost.com

Resource Scan

Scan Details

Site Domain dreamhost.com
Base Domain dreamhost.com
Scan Status Ok
Last Scan2024-05-20T23:12:05+00:00
Next Scan 2024-06-03T23:12:05+00:00

Last Scan

Scanned2024-05-20T23:12:05+00:00
URL https://dreamhost.com/robots.txt
Redirect https://www.dreamhost.com/robots.txt
Redirect Domain www.dreamhost.com
Redirect Base dreamhost.com
Domain IPs 2600:9000:260f:3400:1d:5c4:5c40:93a1, 2600:9000:260f:5200:1d:5c4:5c40:93a1, 2600:9000:260f:5c00:1d:5c4:5c40:93a1, 2600:9000:260f:6000:1d:5c4:5c40:93a1, 2600:9000:260f:7800:1d:5c4:5c40:93a1, 2600:9000:260f:7c00:1d:5c4:5c40:93a1, 2600:9000:260f:a00:1d:5c4:5c40:93a1, 2600:9000:260f:a400:1d:5c4:5c40:93a1, 3.163.24.24, 3.163.24.68, 3.163.24.79, 3.163.24.88
Redirect IPs 108.157.254.109, 108.157.254.116, 108.157.254.17, 108.157.254.35, 2600:9000:2753:5c00:1a:6c26:bb80:93a1, 2600:9000:2753:6e00:1a:6c26:bb80:93a1, 2600:9000:2753:8000:1a:6c26:bb80:93a1, 2600:9000:2753:a00:1a:6c26:bb80:93a1, 2600:9000:2753:a400:1a:6c26:bb80:93a1, 2600:9000:2753:b600:1a:6c26:bb80:93a1, 2600:9000:2753:cc00:1a:6c26:bb80:93a1, 2600:9000:2753:d600:1a:6c26:bb80:93a1
Response IP 108.157.254.116
Found Yes
Hash b75108a36ed383ba778768ec017660f2ed326d837695ec43f0db359a401d9eb6
SimHash 4300acc5eb91

Groups

*

Rule Path
Disallow /legal/former-affiliate-terms-and-conditions/
Disallow /flash-sale-50/
Disallow /newyears-2020-aff/
Disallow /pro-services/management/site-update/php/
Disallow /flash-sale-60/
Disallow /legal/terms-of-service/unstyled.html
Disallow /downloads/
Disallow /abuse.asc
Back to top

Other Records

Field Value
sitemap https://www.dreamhost.com/sitemap-index.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top