Log In Sign Up

hds.com
robots.txt

Robots Exclusion Standard data for hds.com

Resource Scan

Scan Details

Site Domain hds.com
Base Domain hds.com
Scan Status Ok
Last Scan2024-11-05T18:24:54+00:00
Next Scan 2024-11-19T18:24:54+00:00

Last Scan

Scanned2024-11-05T18:24:54+00:00
URL https://www.hds.com/robots.txt
Redirect https://www.hitachivantara.com/robots.txt
Redirect Domain www.hitachivantara.com
Redirect Base hitachivantara.com
Domain IPs 18.155.68.105, 18.155.68.15, 18.155.68.83, 18.155.68.95, 2600:9000:23d2:1200:5:b3a5:e100:93a1, 2600:9000:23d2:3800:5:b3a5:e100:93a1, 2600:9000:23d2:4800:5:b3a5:e100:93a1, 2600:9000:23d2:6800:5:b3a5:e100:93a1, 2600:9000:23d2:a800:5:b3a5:e100:93a1, 2600:9000:23d2:aa00:5:b3a5:e100:93a1, 2600:9000:23d2:c00:5:b3a5:e100:93a1, 2600:9000:23d2:f400:5:b3a5:e100:93a1
Redirect IPs 18.155.68.105, 18.155.68.15, 18.155.68.83, 18.155.68.95, 2600:9000:23d2:1000:5:b3a5:e100:93a1, 2600:9000:23d2:1a00:5:b3a5:e100:93a1, 2600:9000:23d2:2e00:5:b3a5:e100:93a1, 2600:9000:23d2:6800:5:b3a5:e100:93a1, 2600:9000:23d2:7a00:5:b3a5:e100:93a1, 2600:9000:23d2:9c00:5:b3a5:e100:93a1, 2600:9000:23d2:c400:5:b3a5:e100:93a1, 2600:9000:23d2:ce00:5:b3a5:e100:93a1
Response IP 18.155.68.105
Found Yes
Hash 8457718055147fb668c9a88064aebfa13dd8f2a98a4eeeda661002bb479c8b79
SimHash 98dd79cbcd77

Groups

*

Rule Path
Disallow /content/hdscorp/
Disallow /content/hitachi-insight/
Disallow */pdfd/

gotdotnet.ch proxy services

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

abonti/0.8

Rule Path
Disallow /

www.integromedb.org/crawler

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mozilla/5.0 (compatible;jikespider;+http://shoulu.jike.com/spider.html)

Rule Path
Disallow /

sogou orionspider/3.0(+http://www.sogou.com/docs/help/webmasters.htm

Product Comment
sogou orionspider/3.0(+http://www.sogou.com/docs/help/webmasters.htm 07)
Rule Path
Disallow /

sogou webspider/3.0(+http://www.sogou.com/docs/help/webmasters.htm

Product Comment
sogou webspider/3.0(+http://www.sogou.com/docs/help/webmasters.htm 07)
Rule Path
Disallow /

sogou webspider/4.0(+http://www.sogou.com/docs/help/webmasters.htm

Product Comment
sogou webspider/4.0(+http://www.sogou.com/docs/help/webmasters.htm 07)
Rule Path
Disallow /

mozilla/5.0 (compatible; sistrix crawler;http://crawler.sistrix.net/)

Rule Path
Disallow /

apptusbot/2.0

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.hitachivantara.com/sitemap-index.xml
Back to top

Comments

  • /robots.txt for www.hitachivantara.com
Back to top

Warnings

  • 2 invalid lines.
Back to top