publicinterestjournalism.org
robots.txt

Robots Exclusion Standard data for publicinterestjournalism.org

Resource Scan

Scan Details

Site Domain publicinterestjournalism.org
Base Domain publicinterestjournalism.org
Scan Status Ok
Last Scan2024-09-26T12:03:38+00:00
Next Scan 2024-10-03T12:03:38+00:00

Last Scan

Scanned2024-09-26T12:03:38+00:00
URL http://publicinterestjournalism.org/robots.txt
Redirect https://www.propublica.org/robots.txt
Redirect Domain www.propublica.org
Redirect Base propublica.org
Domain IPs 35.168.130.24
Redirect IPs 104.16.251.51, 104.16.252.51, 2606:4700::6810:fb33, 2606:4700::6810:fc33
Response IP 104.16.252.51
Found Yes
Hash be01d51e5e6a2d8b037335884698350536b0183d5a07fd8fe9a7e6962f44ff93
SimHash a3081c0626d2

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/
Disallow /static/projects/investigating-digital-advertising/

Other Records

Field Value
sitemap https://www.propublica.org/sitemap.xml

Comments

  • robots.txt for https://www.propublica.org/