cruceros.uy
robots.txt

Robots Exclusion Standard data for cruceros.uy

Resource Scan

Scan Details

Site Domain cruceros.uy
Base Domain cruceros.uy
Scan Status Ok
Last Scan2024-09-17T04:27:14+00:00
Next Scan 2024-10-17T04:27:14+00:00

Last Scan

Scanned2024-09-17T04:27:14+00:00
URL https://cruceros.uy/robots.txt
Redirect https://www.cruceros.uy/robots.txt
Redirect Domain www.cruceros.uy
Redirect Base cruceros.uy
Domain IPs 13.225.4.10, 13.225.4.126, 13.225.4.13, 13.225.4.8
Redirect IPs 13.225.4.22, 13.225.4.60, 13.225.4.69, 13.225.4.83
Response IP 13.225.4.22
Found Yes
Hash 763e351ba7021ea6e30b01a23ccec5a8347e975b37fc03a971357642152e6888
SimHash 0e43fe90e718

Groups

*

Rule Path
Disallow /
Disallow /ajax/affinage.php
Disallow /ajax/dateJackpot.php
Disallow /ajax/fiche.php
Disallow /ajax/jourferie.php
Disallow /ajax/moteur.php
Disallow /ajax/similaires.php
Disallow /ajax_jourferie.php
Disallow /ajax_moteur.php
Disallow /ajax_moteur_affinage.php
Disallow /ajax_moteurBateau.php
Disallow /ajax_moteurCompagnie.php
Disallow */action?
Disallow /search?
Disallow /search_resa?
Disallow */package-*
Disallow /fp-*
Disallow */tag/*

googlebot
googlebot-image
mediapartners-google
googlebot-news
googlebot-video
google-extended
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
bingbot
adidxbot
duckduckbot
slurp
oncrawl
qwantify
pinterest
ahrefsbot
ahrefssiteaudit
semrushbot
ahrefssiteaudit
barkrowler
chatgpt-user
gptbot

Rule Path
Allow /
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow *package2.html
Disallow /comp_101/
Disallow /ajax/
Disallow /cron/
Disallow /listeV4.php
Disallow /liste.php
Disallow /liste-produits/
Allow /*.jpg************
Allow /*.jpeg************
Allow /*.png************
Allow /*.gif************
Allow /*.webp************
Allow /*.svg************
Allow /*.tif************
Allow /*.mp4***********
Allow /*.css******************
Allow /*.js****************
Allow /*.pdf***************

Other Records

Field Value
sitemap https://www.cruceros.uy/sitemaps/uy/sitemap-index.xml

Comments

  • Block access to all UA by default
  • Disallow miscellaneous page pattern
  • Allow access to specific UA
  • Disallow Blog URL pattern
  • Allow images and special medias