dowjonesanalysis.com
robots.txt
Robots Exclusion Standard data for dowjonesanalysis.com
Resource Scan
Scan Details
| Site Domain | dowjonesanalysis.com |
| Base Domain | dowjonesanalysis.com |
| Scan Status | Ok |
| Last Scan | 2025-12-13T12:46:33+00:00 |
| Next Scan | 2026-01-12T12:46:33+00:00 |
Last Scan
| Scanned | 2025-12-13T12:46:33+00:00 |
| URL | https://dowjonesanalysis.com/robots.txt |
| Redirect | https://www.dowjonesanalysis.com/robots.txt |
| Redirect Domain | www.dowjonesanalysis.com |
| Redirect Base | dowjonesanalysis.com |
| Domain IPs | 104.21.48.155, 172.67.154.66, 2606:4700:3033::ac43:9a42, 2606:4700:3036::6815:309b |
| Redirect IPs | 104.21.48.155, 172.67.154.66, 2606:4700:3033::ac43:9a42, 2606:4700:3036::6815:309b |
| Response IP | 172.67.154.66 |
| Found | Yes |
| Hash | 74f7c0b81286e4640f18f01a03486f94f39392e448eb486f30a65d5547e94dbd |
| SimHash | e9018a188f20 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp- |
| Disallow | /*?* |
| Allow | */uploads |
| Allow | /wp-content/*.css |
| Allow | /wp-includes/*.css |
| Allow | /wp-includes/*.js |
| Allow | /wp-content/*.js |
| Allow | /wp-content/themes/decibel/css/fonts/fontawesome-webfont.woff?v=4.2.0 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://dowjonesanalysis.com/sitemap_index.xml |