publicinterestjournalism.org
robots.txt
Robots Exclusion Standard data for publicinterestjournalism.org
Resource Scan
Scan Details
Site Domain | publicinterestjournalism.org |
Base Domain | publicinterestjournalism.org |
Scan Status | Ok |
Last Scan | 2024-09-26T12:03:38+00:00 |
Next Scan | 2024-10-03T12:03:38+00:00 |
Last Scan
Scanned | 2024-09-26T12:03:38+00:00 |
URL | http://publicinterestjournalism.org/robots.txt |
Redirect | https://www.propublica.org/robots.txt |
Redirect Domain | www.propublica.org |
Redirect Base | propublica.org |
Domain IPs | 35.168.130.24 |
Redirect IPs | 104.16.251.51, 104.16.252.51, 2606:4700::6810:fb33, 2606:4700::6810:fc33 |
Response IP | 104.16.252.51 |
Found | Yes |
Hash | be01d51e5e6a2d8b037335884698350536b0183d5a07fd8fe9a7e6962f44ff93 |
SimHash | a3081c0626d2 |
Groups
*
Rule | Path |
---|---|
Disallow | /cpresources/ |
Disallow | /vendor/ |
Disallow | /.env |
Disallow | /cache/ |
Disallow | /static/projects/investigating-digital-advertising/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.propublica.org/sitemap.xml |
Comments