dowjones.com
robots.txt
Robots Exclusion Standard data for dowjones.com
Resource Scan
Scan Details
| Site Domain | dowjones.com |
| Base Domain | dowjones.com |
| Scan Status | Ok |
| Last Scan | 2024-04-16T01:00:06+00:00 |
| Next Scan | 2024-05-16T01:00:06+00:00 |
Last Scan
| Scanned | 2024-04-16T01:00:06+00:00 |
| URL | https://dowjones.com/robots.txt |
| Redirect | https://www.dowjones.com/robots.txt |
| Redirect Domain | www.dowjones.com |
| Redirect Base | dowjones.com |
| Domain IPs | 35.71.155.29, 52.223.36.79 |
| Redirect IPs | 13.33.88.19, 13.33.88.43, 13.33.88.72, 13.33.88.73, 2600:9000:223b:2800:b:9dd0:e500:93a1, 2600:9000:223b:7400:b:9dd0:e500:93a1, 2600:9000:223b:7a00:b:9dd0:e500:93a1, 2600:9000:223b:c600:b:9dd0:e500:93a1, 2600:9000:223b:dc00:b:9dd0:e500:93a1, 2600:9000:223b:de00:b:9dd0:e500:93a1, 2600:9000:223b:e200:b:9dd0:e500:93a1, 2600:9000:223b:f800:b:9dd0:e500:93a1 |
| Response IP | 13.33.88.73 |
| Found | Yes |
| Hash | 3ba87a175e57815ad4385a7b5ac4b3c9e08a3e23ef1faaa97a933c92708d5f63 |
| SimHash | 61045c40cdd1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.dowjones.com/sitemap_index.xml |
| sitemap | https://www.dowjones.com/professional/sitemap_index.xml |