azur-croisieres.com
robots.txt

Robots Exclusion Standard data for azur-croisieres.com

Resource Scan

Scan Details

Site Domain azur-croisieres.com
Base Domain azur-croisieres.com
Scan Status Ok
Last Scan2024-08-31T06:56:33+00:00
Next Scan 2024-09-30T06:56:33+00:00

Last Scan

Scanned2024-08-31T06:56:33+00:00
URL https://azur-croisieres.com/robots.txt
Redirect https://www.azur-croisieres.com/robots.txt
Redirect Domain www.azur-croisieres.com
Redirect Base azur-croisieres.com
Domain IPs 108.157.254.3, 108.157.254.54, 108.157.254.77, 108.157.254.84
Redirect IPs 52.84.229.32, 52.84.229.71, 52.84.229.73, 52.84.229.79
Response IP 52.84.229.73
Found Yes
Hash 112ced173dd2281495a1d5bc1c7e0b6bed83ca37d7a504891efba1cbf44545db
SimHash 4c51ff90e700

Groups

*

Rule Path
Disallow /

googlebot
googlebot-image
mediapartners-google
googlebot-news
googlebot-video
google-extended
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
bingbot
adidxbot
duckduckbot
slurp
oncrawl
qwantify
pinterest
ahrefsbot
ahrefssiteaudit
semrushbot
ahrefssiteaudit
barkrowler
chatgpt-user
gptbot

Rule Path
Allow /
Disallow /ajax/affinage.php
Disallow /ajax/dateJackpot.php
Disallow /ajax/fiche.php
Disallow /ajax/jourferie.php
Disallow /ajax/moteur.php
Disallow /ajax/similaires.php
Disallow /ajax_jourferie.php
Disallow /ajax_moteur.php
Disallow /ajax_moteur_affinage.php
Disallow /ajax_moteurBateau.php
Disallow /ajax_moteurCompagnie.php
Disallow */action?
Disallow /search?
Disallow /search_resa?
Disallow */package-*
Disallow */Mj*
Disallow /fp-*

adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps

Rule Path
Allow /********************

feedfetcher-google
googleproducer

Rule Path
Allow /********************
Disallow /blog/wp-admin/
Allow /blog/wp-admin/admin-ajax.php
Disallow /blog/*/trackback
Disallow /blog/*/comments
Disallow /blog/cgi-bin
Disallow /blog/*.php$
Disallow /blog/*.inc$
Disallow /blog/*.gz
Disallow /blog/*.cgi
Allow /*.jpg************
Allow /*.jpeg************
Allow /*.png************
Allow /*.gif************
Allow /*.webp************
Allow /*.svg************
Allow /*.tif************
Allow /*.mp4***********
Allow /*.css******************
Allow /*.js****************
Allow /*.pdf***************

Other Records

Field Value
sitemap https://www.azur-croisieres.com/blog/sitemap_index.xml
sitemap https://www.azur-croisieres.com/theme-sitemap.xml
sitemap https://www.azur-croisieres.com/mois-sitemap.xml
sitemap https://www.azur-croisieres.com/port-sitemap.xml
sitemap https://www.azur-croisieres.com/destination-sitemap.xml
sitemap https://www.azur-croisieres.com/compagnie-sitemap.xml
sitemap https://www.azur-croisieres.com/bateau-sitemap.xml

Comments

  • Block access to all UA by default
  • Allow access to specific UA
  • Allow search to Ads-bot
  • Allow Discover
  • filtrage du wordpress
  • Allow images and special medias
  • sitemaps blog et site