dowjonesrisk.com
robots.txt
Robots Exclusion Standard data for dowjonesrisk.com
Resource Scan
Scan Details
Site Domain | dowjonesrisk.com |
Base Domain | dowjonesrisk.com |
Scan Status | Ok |
Last Scan | 2025-08-27T14:35:12+00:00 |
Next Scan | 2025-09-26T14:35:12+00:00 |
Last Scan
Scanned | 2025-08-27T14:35:12+00:00 |
URL | https://dowjonesrisk.com/robots.txt |
Redirect | https://www.dowjonesrisk.com/robots.txt |
Redirect Domain | www.dowjonesrisk.com |
Redirect Base | dowjonesrisk.com |
Domain IPs | 104.21.4.6, 172.67.131.108, 2606:4700:3030::ac43:836c, 2606:4700:3037::6815:406 |
Redirect IPs | 104.21.4.6, 172.67.131.108, 2606:4700:3030::ac43:836c, 2606:4700:3037::6815:406 |
Response IP | 172.67.131.108 |
Found | Yes |
Hash | 694900fdb34c41d9ddfc300b600f7627ef047c306ead778cc3d07f611a2d5931 |
SimHash | e8219b40a330 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /wp- |
Disallow | /*?* |
Allow | */uploads |
Allow | /wp-*/*.css |
Allow | /wp-*/*.js |
Allow | /wp-*/*.woff* |
Allow | /wp-*/*.ttf |
Allow | */wmac/js/*.js |
Allow | /wp-content/themes/*/images |
Allow | /images |
Other Records
Field | Value |
---|---|
sitemap | https://dowjonesrisk.com/sitemap_index.xml |