static.openfoodfacts.org
robots.txt
Robots Exclusion Standard data for static.openfoodfacts.org
Resource Scan
Scan Details
Site Domain | static.openfoodfacts.org |
Base Domain | openfoodfacts.org |
Scan Status | Ok |
Last Scan | 2024-10-02T22:59:24+00:00 |
Next Scan | 2024-10-16T22:59:24+00:00 |
Last Scan
Scanned | 2024-10-02T22:59:24+00:00 |
URL | https://static.openfoodfacts.org/robots.txt |
Redirect | https://world.openfoodfacts.org/robots.txt |
Redirect Domain | world.openfoodfacts.org |
Redirect Base | openfoodfacts.org |
Domain IPs | 213.36.253.214 |
Redirect IPs | 213.36.253.214 |
Response IP | 213.36.253.214 |
Found | Yes |
Hash | 58f60fbfc43384282cd2d7c3feb9dd48784a79875d5f4b4899637f4e85c04f01 |
SimHash | 485c8591d744 |
Groups
*
Rule | Path |
---|---|
Allow | /cgi/product_image.pl |
Allow | /cgi/opensearch.pl |
Disallow | /cgi |
Disallow | /code |
Disallow | /api |
Disallow | /additives |
Disallow | /allergen |
Disallow | /allergens |
Disallow | /amino-acid |
Disallow | /amino-acids |
Disallow | /brands |
Disallow | /categories |
Disallow | /categories-properties |
Disallow | /checker |
Disallow | /checkers |
Disallow | /city |
Disallow | /cities |
Disallow | /code |
Disallow | /codes |
Disallow | /corrector |
Disallow | /correctors |
Disallow | /country |
Disallow | /countries |
Disallow | /data-quality |
Disallow | /data-quality-bug |
Disallow | /data-quality-bugs |
Disallow | /data-quality-error |
Disallow | /data-quality-errors |
Disallow | /data-quality-error-producers |
Disallow | /data-quality-errors-producers |
Disallow | /data-quality-info |
Disallow | /data-quality-warning |
Disallow | /data-quality-warnings |
Disallow | /data-quality-warning-producers |
Disallow | /data-quality-warnings-producers |
Disallow | /data-source |
Disallow | /data-sources |
Disallow | /debug |
Disallow | /editor |
Disallow | /editors |
Disallow | /packager-code |
Disallow | /packager-codes |
Disallow | /entry-date |
Disallow | /entry-dates |
Disallow | /food-group |
Disallow | /food-groups |
Disallow | /import |
Disallow | /imports |
Disallow | /possible-improvement |
Disallow | /possible-improvements |
Disallow | /informer |
Disallow | /informers |
Disallow | /ingredient |
Disallow | /ingredients |
Disallow | /ingredients-analysis |
Disallow | /ingredients-from-palm-oil |
Disallow | /number-of-ingredients |
Disallow | /numbers-of-ingredients |
Disallow | /ingredient-original |
Disallow | /ingredients-original |
Disallow | /ingredients-that-may-be-from-palm-oil |
Disallow | /known-nutrient |
Disallow | /known-nutrients |
Disallow | /labels |
Disallow | /language |
Disallow | /languages |
Disallow | /last-check-date |
Disallow | /last-check-dates |
Disallow | /last-edit-date |
Disallow | /last-edit-dates |
Disallow | /last-image-date |
Disallow | /last-image-dates |
Disallow | /manufacturing-place |
Disallow | /manufacturing-places |
Disallow | /mineral |
Disallow | /minerals |
Disallow | /misc |
Disallow | /mission |
Disallow | /missions |
Disallow | /nova-groups |
Disallow | /nucleotide |
Disallow | /nucleotides |
Disallow | /nutrient-level |
Disallow | /nutrient-levels |
Disallow | /nutrient |
Disallow | /nutrients |
Disallow | /nutri-score |
Disallow | /nutri-score-2021 |
Disallow | /nutri-score-2023 |
Disallow | /nutrition-grades |
Disallow | /origin |
Disallow | /origins |
Disallow | /other-nutritional-substance |
Disallow | /other-nutritional-substances |
Disallow | /owner |
Disallow | /owners |
Disallow | /packaging |
Disallow | /packaging-materials |
Disallow | /packaging-recycling |
Disallow | /packaging-shape |
Disallow | /packaging-shapes |
Disallow | /period-after-opening |
Disallow | /periods-after-opening |
Disallow | /photographer |
Disallow | /photographers |
Disallow | /pnns-group-1 |
Disallow | /pnns-groups-1 |
Disallow | /pnns-group-2 |
Disallow | /pnns-groups-2 |
Disallow | /popularity |
Disallow | /purchase-place |
Disallow | /purchase-places |
Disallow | /quality |
Disallow | /state |
Disallow | /states |
Disallow | /store |
Disallow | /stores |
Disallow | /team |
Disallow | /teams |
Disallow | /trace |
Disallow | /traces |
Disallow | /unknown-nutrient |
Disallow | /unknown-nutrients |
Disallow | /contributor |
Disallow | /contributors |
Disallow | /vitamin |
Disallow | /vitamins |
Disallow | /weigher |
Disallow | /weighers |
Comments