cuisine-news.fr
robots.txt

Robots Exclusion Standard data for cuisine-news.fr

Resource Scan

Scan Details

Site Domain cuisine-news.fr
Base Domain cuisine-news.fr
Scan Status Ok
Last Scan2024-06-11T20:52:40+00:00
Next Scan 2024-06-18T20:52:40+00:00

Last Scan

Scanned2024-06-11T20:52:40+00:00
URL http://www.cuisine-news.fr/robots.txt
Redirect https://www.cuisineactuelle.fr/robots.txt
Redirect Domain www.cuisineactuelle.fr
Redirect Base cuisineactuelle.fr
Domain IPs 217.70.184.50
Response IP 104.69.168.142
Found Yes
Hash 95b6567b526e20f374df72a906368c46690d4f4a98022611fef21c3bcf57a1f1
SimHash 05a01ed06280

Groups

*

Rule Path
Disallow */1000
Disallow *optinConfig*
Disallow *brandconfiguration.json*
Disallow /*/%28page%29/*cac*
Disallow /*/%28offset%29/*cac*
Disallow /*/%28page%29/*fac*
Disallow /*/%28offset%29*fac*
Disallow /*/%28page%29/*tel*
Disallow /*/%28offset%29/*tel*
Disallow /*/%28page%29/*bea*
Disallow /*/%28offset%29/*bea*
Disallow /*/%28page%29/*neo*
Disallow /*/%28offset%29/*neo*
Disallow /*/%28page%29/*geo*
Disallow /*/%28offset%29/*geo*
Disallow /*/%28page%29/*cam*
Disallow /*/%28offset%29/*cam*
Disallow /*/%28page%29/*voi*
Disallow /*/%28offset%29/*voi*
Disallow /*/%28page%29/*gal*
Disallow /*/%28offset%29/*gal*
Disallow /*/%28page%29/*ser*
Disallow /*/%28offset%29/*ser*
Disallow /*/%28offset%29/*/%28offset%29/*
Disallow *?offset=bea*
Disallow *?offset=cac*
Disallow *?offset=fac*
Disallow *?offset=tel*
Disallow *?offset=gal*
Disallow *?offset=voi*
Disallow *?offset=cam*
Disallow *?offset=neo*
Disallow *?offset=*%2FoptinConfig
Disallow *?offset=geo*
Disallow /one/
Disallow /content/tipafriend/
Disallow /layout/set/print/
Disallow /layout/set/ajax/content/view
Disallow /prismaajaxcomment/
Disallow /rss/feed/
Disallow /user/register
Disallow *?SearchText=*&*
Disallow /content/search/%28offset%29/*?SearchText=*
Disallow /content/search/*?SearchText=*
Disallow *?Search=*
Disallow *%28sortby%29*
Disallow *%28session%29*
Disallow *%28filter%29*
Disallow *%28direction%29*
Disallow *function.filesize*
Disallow /sondage/sondage/*
Disallow /prismaajaxrate/*
Disallow *xtor%3D*
Disallow /content/view/full/
Disallow /editos/*
Disallow /prismacuiuserinformations/*
Disallow /users/guest-accounts/
Disallow /valid_user
Disallow /bookmarks/*
Disallow /bookmark/get/
Disallow /profile/private
Disallow /assets/scripts/esm.recipe.js
Disallow /content/search*
Allow /content/search?search%5Btext%5D=*
Disallow /content/search?search%5Btext%5D=*&
Allow /content/search?*&search%5Bsort%5D=relevance*

mediapartners-google

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.cuisineactuelle.fr/sitemap.xml

Comments

  • robots.txt
  • crawl issue 2020-03
  • Gestion des pages de recherches