Log In Sign Up

phoneia.com
robots.txt

Robots Exclusion Standard data for phoneia.com

Resource Scan

Scan Details

Site Domain phoneia.com
Base Domain phoneia.com
Scan Status Ok
Last Scan2024-11-11T14:52:20+00:00
Next Scan 2024-11-18T14:52:20+00:00

Last Scan

Scanned2024-11-11T14:52:20+00:00
URL https://phoneia.com/robots.txt
Domain IPs 104.21.17.5, 172.67.218.12, 2606:4700:3031::ac43:da0c, 2606:4700:3035::6815:1105
Response IP 172.67.218.12
Found Yes
Hash 28f9b162df2bfaef719fcd9627c73b55c5091ba0d50bd7f0cd714ae4fc2c9e5a
SimHash de56153a2e39

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /tag/
Disallow /*/amp/
Disallow /*/*/page/
Disallow /*/*/*/page/
Disallow /*/feed/
Disallow /*/*/feed/
Disallow /*/*/*/feed/
Disallow /*/rss/
Disallow /*/*/rss/
Disallow /*/*/*/rss/
Disallow /?
Disallow /*?
Disallow /*/?
Disallow /*/*/?
Disallow /*/*/*/?
Disallow /search
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

httrack

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

wget

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

acunetix

Rule Path
Disallow /

nikto

Rule Path
Disallow /

sqlmap

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

amazon-kendra

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20
Back to top

Other Records

Field Value
sitemap https://definiciona.com/sitemap.xml
Back to top

Comments

  • Specific robot directives / Directivas especí­ficas para robots:
  • Phoneia content is made available under our terms and conditions; for personal, non-commercial use / El contenido de Phoneia está disponible bajo nuestros términos y condiciones; para uso personal, no comercial;
  • Use of any device, tool, or process designed to data mine or scrape the content, using automated means, it is prohibited without prior written permission from Phoneia / El uso de cualquier dispositivo, herramienta o proceso diseñado para extraer datos o raspar el contenido, utilizando medios automatizados, está prohibido sin el permiso previo por escrito de Phoneia.
  • Prohibited uses include but are not limited to: / Los usos prohibidos del contenido incluyen, entre otros:
  • (1) text and data mining activities; / (1) actividades de minería de textos y datos;
  • (2) the development of any software, machine learning, artificial intelligence (AI), and/or large language models (LLMs); / (2) el desarrollo de cualquier software, aprendizaje automático, inteligencia artificial (IA) y/o grandes modelos de lenguaje (LLM);
  • (3) creating or providing archived or cached data sets containing our content to others; and/or / (3) crear o proporcionar conjuntos de datos archivados o en caché que contengan nuestro contenido a otros; y/o
  • (4) any commercial purposes / (4) cualquier propósito comercial.
Back to top