corralejo.info
robots.txt

Robots Exclusion Standard data for corralejo.info

Resource Scan

Scan Details

Site Domain corralejo.info
Base Domain corralejo.info
Scan Status Ok
Last Scan2026-02-26T04:38:59+00:00
Next Scan 2026-03-05T04:38:59+00:00

Last Scan

Scanned2026-02-26T04:38:59+00:00
URL https://corralejo.info/robots.txt
Redirect https://www.corralejo.info/robots.txt
Redirect Domain www.corralejo.info
Redirect Base corralejo.info
Domain IPs 34.175.65.158
Redirect IPs 34.175.65.158
Response IP 34.175.65.158
Found Yes
Hash 349a46a3f8092558d7e844779bb8e083ea3a5b6af3dc86e6b6b1560fb3a6d37a
SimHash 4b3e5b5a2a3b

Groups

*

Rule Path
Disallow /feed/
Disallow /*/feed/
Disallow /comments/feed/
Disallow /tag/
Disallow /?s=
Disallow /search/
Disallow /?page_id=
Disallow /wp-json/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /author/
Disallow /date/
Disallow /*.php$
Disallow /*.cgi$
Disallow /*.asp$
Disallow /*.js$
Disallow /*.css$
Disallow /cgi-bin/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /wp-snapshots/
Disallow /uploads/elementor/
Allow /wp-content/uploads/

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.corralejo.info/sitemap_index.xml

Comments

  • Blocca i feed RSS e RSS delle categorie
  • Blocca le pagine dei tag
  • Blocca URL di ricerca interni
  • Blocca i parametri di query inutili generati da Elementor o WordPress
  • Blocca archivi poco utili
  • Evita l'indicizzazione di file specifici inutili
  • Blocca directory che non devono essere scansionate
  • Evita che Googlebot indicizzi immagini duplicate in Elementor
  • Consenti la scansione delle risorse necessarie
  • Blocca bot inutili o indesiderati
  • Sitemap generata da RankMath