ayudawp.com
robots.txt

Robots Exclusion Standard data for ayudawp.com

Resource Scan

Scan Details

Site Domain ayudawp.com
Base Domain ayudawp.com
Scan Status Ok
Last Scan2024-09-26T09:00:53+00:00
Next Scan 2024-10-03T09:00:53+00:00

Last Scan

Scanned2024-09-26T09:00:53+00:00
URL https://ayudawp.com/robots.txt
Domain IPs 104.21.49.125, 172.67.162.254, 2606:4700:3033::ac43:a2fe, 2606:4700:3036::6815:317d
Response IP 172.67.162.254
Found Yes
Hash b0325f1e4d714a107384349526ceb2cc8afe5b02abfb6d854ffb4f9178762a87
SimHash 3316e050ca30

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /recomiendo/
Disallow /?s=
Disallow /search

compspybot
curious george
cybeye.com
docomo
exb language crawler
ezooms
flamingo_searchengine
genieo
genio
lwnutch
lexxebot
openwebindex
rediffnewsbot
seoengworldbot
scanmine
screaming frog seo spider
shopwiki
showyoubot
sosospider
wocbot
yeti
yeti
youdaobot
daumoa
gsa-crawler
libcrawl
linkdex
magpie-crawler
repparser
rogerbot
sindice-site-manager
sogou spider
sogou
woriobot
yacybot
yolinkbot
amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

chatgpt

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://ayudawp.com/sitemaps.xml

Comments

  • Reglas tipicas para WordPress
  • Bots chungos o que consumen ancho de banda
  • No queremos regalar contenido a la IAs de ChatGPT y similares