yoextranjero.com
robots.txt

Robots Exclusion Standard data for yoextranjero.com

Resource Scan

Scan Details

Site Domain yoextranjero.com
Base Domain yoextranjero.com
Scan Status Ok
Last Scan2024-09-30T00:37:04+00:00
Next Scan 2024-10-07T00:37:04+00:00

Last Scan

Scanned2024-09-30T00:37:04+00:00
URL https://yoextranjero.com/robots.txt
Domain IPs 2a02:4780:27:1144:0:955:228:2, 62.72.37.50
Response IP 62.72.37.50
Found Yes
Hash 6fb3b04ab149a21dfecff65edd2c012cae8aff5faf6bd012cf3e25fef978ce88
SimHash b316e052ca30

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /?s=
Disallow /search

compspybot
curious george
cybeye.com
docomo
exb language crawler
ezooms
flamingo_searchengine
genieo
genio
lwnutch
lexxebot
openwebindex
rediffnewsbot
seoengworldbot
scanmine
screaming frog seo spider
shopwiki
showyoubot
sosospider
wocbot
yeti
yeti
youdaobot
daumoa
gsa-crawler
libcrawl
linkdex
magpie-crawler
repparser
rogerbot
sindice-site-manager
sogou spider
sogou
woriobot
yacybot
yolinkbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

chatgpt

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Comments

  • Reglas tipicas para WordPress
  • Bots chungos o que consumen ancho de banda
  • No queremos regalar contenido a la IAs de ChatGPT y similares