hitachi.com
robots.txt

Robots Exclusion Standard data for hitachi.com

Resource Scan

Scan Details

Site Domain hitachi.com
Base Domain hitachi.com
Scan Status Ok
Last Scan2024-06-26T12:56:46+00:00
Next Scan 2024-07-26T12:56:46+00:00

Last Scan

Scanned2024-06-26T12:56:46+00:00
URL https://www.hitachi.com/robots.txt
Domain IPs 2600:9000:21b4:5200:9:1b9d:a840:93a1, 2600:9000:21b4:5e00:9:1b9d:a840:93a1, 2600:9000:21b4:6000:9:1b9d:a840:93a1, 2600:9000:21b4:7a00:9:1b9d:a840:93a1, 2600:9000:21b4:8000:9:1b9d:a840:93a1, 2600:9000:21b4:c400:9:1b9d:a840:93a1, 2600:9000:21b4:cc00:9:1b9d:a840:93a1, 2600:9000:21b4:f400:9:1b9d:a840:93a1, 65.8.11.109, 65.8.11.125, 65.8.11.32, 65.8.11.76
Response IP 13.225.4.54
Found Yes
Hash 073f91188f905282eeabeddcb7242234c9955bb38a90f406f6cbee2b6736a823
SimHash a0df59c3ce32

Groups

*

Rule Path
Disallow /css/
Disallow /image/
Disallow /images/

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

Other Records

Field Value
sitemap http://http://www.hitachi.com/sitemap.xml

Comments

  • /robots.txt for http://www.hitachi.com/