Log In Sign Up

dowjones.co.jp
robots.txt

Robots Exclusion Standard data for dowjones.co.jp

Resource Scan

Scan Details

Site Domain dowjones.co.jp
Base Domain dowjones.co.jp
Scan Status Ok
Last Scan2024-08-31T12:24:12+00:00
Next Scan 2024-09-30T12:24:12+00:00

Last Scan

Scanned2024-08-31T12:24:12+00:00
URL https://www.dowjones.co.jp/robots.txt
Domain IPs 13.35.18.100, 13.35.18.121, 13.35.18.25, 13.35.18.40, 2600:9000:20c7:1c00:5:bb22:8240:93a1, 2600:9000:20c7:4200:5:bb22:8240:93a1, 2600:9000:20c7:4600:5:bb22:8240:93a1, 2600:9000:20c7:8a00:5:bb22:8240:93a1, 2600:9000:20c7:9400:5:bb22:8240:93a1, 2600:9000:20c7:9c00:5:bb22:8240:93a1, 2600:9000:20c7:ee00:5:bb22:8240:93a1, 2600:9000:20c7:f800:5:bb22:8240:93a1
Response IP 13.35.18.25
Found Yes
Hash 3ba87a175e57815ad4385a7b5ac4b3c9e08a3e23ef1faaa97a933c92708d5f63
SimHash 61045c40cdd1

Groups

*

Rule Path
Disallow /logos
Disallow /wp-links-opml.php
Back to top

Other Records

Field Value
sitemap https://www.dowjones.com/sitemap_index.xml
sitemap https://www.dowjones.com/professional/sitemap_index.xml
Back to top