atelierdeschefs.fr
robots.txt

Robots Exclusion Standard data for atelierdeschefs.fr

Resource Scan

Scan Details

Site Domain atelierdeschefs.fr
Base Domain atelierdeschefs.fr
Scan Status Ok
Last Scan2024-05-31T14:05:11+00:00
Next Scan 2024-06-07T14:05:11+00:00

Last Scan

Scanned2024-05-31T14:05:11+00:00
URL https://atelierdeschefs.fr/robots.txt
Redirect https://www.atelierdeschefs.fr/robots.txt
Redirect Domain www.atelierdeschefs.fr
Redirect Base atelierdeschefs.fr
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.123, 76.76.21.9
Response IP 76.76.21.98
Found Yes
Hash 08fcffc600cec32f10be653f8d34d68420877febbf9ecc183bf83685459e4d37
SimHash 4b5de2540fb0

Groups

*

Rule Path
Allow /
Disallow /cours-de-cuisine/*/*/
Disallow /*/envoirecette
Disallow /*ICN%3DPROPOSITION_RECETTE_PAGE_RECETTE

admantx
boitho.com-dc
cazoodlebot
converacrawler
discobot
dotbot
echoping
exabot
fasterfox
genieo
gigabot
grapeshot
heritrix
huaweisymantecspider
ia_archiver
ichiro
irlbot
jakarta
kalooga
lexxebot
magpie-crawler
mlbot
msiecrawler
naverbot
ocelli
penthesilea
phpdig
proximic
scoutjet
searchdaimon.com-dc
semvisubot
shopwiki
snapbot
turnitinbot
twengabot
twiceler
wget
woozweb-monitoring
woriobot
yacybit
yacybot
yandex
yandexbot
yeti
yodaobot
zyborg

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.atelierdeschefs.fr/sitemap.xml
sitemap https://sitemaps.atelierdeschefs.fr/sitemap-recipes.xml

Comments

  • Host
  • Sitemaps
  • *
  • BanBadBot

Warnings

  • `host` is not a known field.