Parse Robots Exclusion Standard

Submit a robots.txt /.well-known/ resource to be parsed.