ah.nl
robots.txt

Robots Exclusion Standard data for ah.nl

Resource Scan

Scan Details

Site Domain ah.nl
Base Domain ah.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-18T17:30:12+00:00
Next Scan 2024-07-17T17:30:12+00:00

Last Successful Scan

Scanned2023-06-17T11:28:09+00:00
URL https://ah.nl/robots.txt
Redirect https://www.ah.nl/robots.txt
Redirect Domain www.ah.nl
Redirect Base ah.nl
Domain IPs 23.52.171.227, 23.59.168.185
Redirect IPs 23.215.7.16, 23.215.7.18
Response IP 23.52.171.227
Found Yes
Hash 1fb7f80c097f0a7a304ded08e7aa1424249a582765791353fe5fa20c145f513d
SimHash 722158fdcf93

Groups

*

Rule Path
Disallow /fdp
Disallow /koahg
Disallow /bewaarde-recepten/
Disallow /data/
Allow /data/winkelinformatie/winkels*
Disallow /fallback/
Disallow /fotoservice/client_redirect.jsp
Disallow /kookschrift/recepten/verstuur
Disallow /kookschrift2
Disallow /mijn/
Disallow /allerhande/?page=
Disallow /allerhande?page=
Disallow /allerhande/recepten/?page=
Disallow /allerhande/recepten?page=
Disallow /allerhande/recepten/raterecept
Disallow /allerhande/recepten/verstuur
Disallow /allerhande/*?kooktechniek=*
Disallow /allerhande/*?veel-gebruikt=*
Disallow /allerhande/*?menugang=*
Disallow /allerhande/*?soort-gerecht=*
Disallow /allerhande/*?recepten-met=*
Disallow /allerhande/*?speciale-wensen=*
Disallow /allerhande/*?momenten=*
Disallow /allerhande/*?seizoen=*
Disallow /allerhande/*?allerhande-magazine=*
Disallow /allerhande/*/soort-gerecht%3A*
Disallow /allerhande/*/seizoen%3A*
Disallow /allerhande/*/menugang%3A*
Disallow /allerhande/*/kooktechniek%3A*
Disallow /allerhande/*/veel-gebruikt%3A*
Disallow /allerhande/*/menugang%3A*
Disallow /allerhande/*/soort-gerecht%3A*
Disallow /allerhande/*/recepten-met%3A*
Disallow /allerhande/*/speciale-wensen%3A*
Disallow /allerhande/*/momenten%3A*
Disallow /allerhande/*/seizoen%3A*
Disallow /allerhande/*/speciale-wensen%3A*
Disallow /productvoorstel/
Disallow /allerhande2/
Allow /allerhande2/assets/
Disallow /rev05/
Disallow /ui/
Disallow /website/
Disallow /zoeken/
Allow /zoeken/assets/
Allow /zoeken/api/
Disallow /module/cookbook-summary
Disallow /allerhande/nl/data/
Disallow /allerhande*/__/*
Disallow /recepten/
Disallow /producten/eerder-gekocht
Disallow /bezorgen
Disallow /bestellen/bestelling-controleren
Disallow /bestellen/overzicht
Disallow /shl
Disallow /ophalen/moment
Disallow /product/foodlabel/
Disallow /klantenservice?s=*
Disallow /bonus/groep/*?week=*dclid=*
Disallow /producten/*?*
Disallow /producten?*
Allow /producten/merk?letter=*
Allow /producten/*?kenmerk=feestfavoriet
Disallow /producten/*?kenmerk=feestfavoriet&*
Disallow /producten/*%26kenmerk%3Dfeestfavoriet*
Allow /producten/*?kenmerk=bonus
Disallow /producten/*?kenmerk=bonus&*
Disallow /producten/*%26kenmerk%3Dbonus*
Allow /producten/*?kenmerk=biologisch
Disallow /producten/*?kenmerk=biologisch&*
Disallow /producten/*%26kenmerk%3Dbiologisch*
Disallow /producten/*?page=*&*
Allow /producten/*?page=*&withOffset=true
Disallow /producten/*undefined
Disallow /winkels*?*
Allow /winkels*?page=*
Allow /winkels*?letter=*
Disallow /winkels*letter%3D*%26*
Allow /service/rest

adsbot-google

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

adidxbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.ah.nl/sitemaps/sitemap-allerhande.xml
sitemap https://www.ah.nl/sitemaps/entities/allerhande/recipes.xml
sitemap https://www.ah.nl/sitemaps/entities/allerhande/videos.xml
sitemap https://www.ah.nl/sitemaps/entities/stores/stores.xml
sitemap https://www.ah.nl/sitemaps/entities/products/categories.xml
sitemap https://www.ah.nl/sitemaps/entities/products/detail.xml
sitemap https://www.ah.nl/sitemaps/entities/products/brands.xml
sitemap https://www.ah.nl/sitemaps/sitemap-core.xml
sitemap https://www.ah.nl/sitemaps/sitemap-content.xml
sitemap https://www.ah.nl/sitemaps/sitemap-klantenservice.xml
sitemap https://www.ah.nl/sitemaps/sitemap-zakelijk.xml
sitemap https://www.ah.nl/sitemaps/sitemap-over-ah.xml
sitemap https://www.ah.nl/sitemaps/sitemap-acties.xml
sitemap https://www.ah.nl/bonus/assets/sitemap_nl.xml

Comments

  • HTTP/1.1 200 OK
  • fail-safes, allow the ads-bot checkers everything.
  • (Disallow: means, allow everything)
  • Bing Ads