Log In Sign Up

laspoesias.com
robots.txt

Robots Exclusion Standard data for laspoesias.com

Resource Scan

Scan Details

Site Domain laspoesias.com
Base Domain laspoesias.com
Scan Status Ok
Last Scan2024-11-12T17:21:03+00:00
Next Scan 2024-11-19T17:21:03+00:00

Last Scan

Scanned2024-11-12T17:21:03+00:00
URL https://laspoesias.com/robots.txt
Domain IPs 104.21.93.83, 172.67.207.157, 2606:4700:3033::6815:5d53, 2606:4700:3033::ac43:cf9d
Response IP 172.67.207.157
Found Yes
Hash 4cd8f57701acb9dcbabbad830cf62fbdf57b80b5c59407686862b05a543f1883
SimHash de56113a2e39

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /tag/
Disallow /*/amp/
Disallow /*/*/page/
Disallow /*/*/*/page/
Disallow /*/feed/
Disallow /*/*/feed/
Disallow /*/*/*/feed/
Disallow /*/rss/
Disallow /*/*/rss/
Disallow /*/*/*/rss/
Disallow /?
Disallow /*?
Disallow /*/?
Disallow /*/*/?
Disallow /*/*/*/?
Disallow /search
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

httrack

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

wget

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

acunetix

Rule Path
Disallow /

nikto

Rule Path
Disallow /

sqlmap

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

amazon-kendra

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20
Back to top

Other Records

Field Value
sitemap https://definiciona.com/sitemap.xml
Back to top

Comments

  • Specific robot directives / Directivas especí­ficas para robots:
  • Las poesias content is made available under our terms and conditions; for personal, non-commercial use / El contenido de Las poesias está disponible bajo nuestros términos y condiciones; para uso personal, no comercial;
  • Use of any device, tool, or process designed to data mine or scrape the content, using automated means, it is prohibited without prior written permission from Las poesias / El uso de cualquier dispositivo, herramienta o proceso diseñado para extraer datos o raspar el contenido, utilizando medios automatizados, está prohibido sin el permiso previo por escrito de Las poesias.
  • Prohibited uses include but are not limited to: / Los usos prohibidos del contenido incluyen, entre otros:
  • (1) text and data mining activities; / (1) actividades de minería de textos y datos;
  • (2) the development of any software, machine learning, artificial intelligence (AI), and/or large language models (LLMs); / (2) el desarrollo de cualquier software, aprendizaje automático, inteligencia artificial (IA) y/o grandes modelos de lenguaje (LLM);
  • (3) creating or providing archived or cached data sets containing our content to others; and/or / (3) crear o proporcionar conjuntos de datos archivados o en caché que contengan nuestro contenido a otros; y/o
  • (4) any commercial purposes / (4) cualquier propósito comercial.
Back to top