api.npr.org
robots.txt

Robots Exclusion Standard data for api.npr.org

Resource Scan

Scan Details

Site Domain api.npr.org
Base Domain npr.org
Scan Status Ok
Last Scan2024-06-20T20:11:41+00:00
Next Scan 2024-06-27T20:11:41+00:00

Last Scan

Scanned2024-06-20T20:11:41+00:00
URL https://api.npr.org/robots.txt
Domain IPs 23.52.40.16, 23.52.40.34, 2600:1413:5000:13::1737:27c8, 2600:1413:5000:13::1737:27ce
Response IP 23.59.168.168
Found Yes
Hash 071181248ca186a98246e94c41477caa470476e16efc6f21b58b159da691846f
SimHash 9a11db4105f1

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Allow /query/

Comments

  • robots.txt for s.npr.org/static asset servers
  • Changes are tracked in npr_seamus
  • Allow Google Home to index roll-your-own-podcasts on api.npr.org