oakhost.net
robots.txt

Robots Exclusion Standard data for oakhost.net

Resource Scan

Scan Details

Site Domain oakhost.net
Base Domain oakhost.net
Scan Status Ok
Last Scan2024-06-03T03:35:20+00:00
Next Scan 2024-06-17T03:35:20+00:00

Last Scan

Scanned2024-06-03T03:35:20+00:00
URL https://oakhost.net/robots.txt
Redirect https://www.oakhost.net/robots.txt
Redirect Domain www.oakhost.net
Redirect Base oakhost.net
Domain IPs 104.21.40.89, 172.67.183.69, 2606:4700:3035::6815:2859, 2606:4700:3035::ac43:b745
Redirect IPs 104.21.40.89, 172.67.183.69, 2606:4700:3035::6815:2859, 2606:4700:3035::ac43:b745
Response IP 104.21.40.89
Found Yes
Hash 60d215b29580950c6bc6327eba58972c5b9b960da58ca8f842adaf37093500ec
SimHash 1e58da622493

Groups

*

Rule Path
Disallow /checkout
Disallow /de/checkout
Disallow /tos
Disallow /de/tos
Disallow /privacy
Disallow /de/privacy
Disallow /imprint
Disallow /de/imprint
Disallow /login
Disallow /de/login
Disallow /register
Disallow /de/register
Disallow /*?country=

archive.org_bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

yandex

Rule Path
Disallow /