encyclobjects.com
robots.txt

Robots Exclusion Standard data for encyclobjects.com

Resource Scan

Scan Details

Site Domain encyclobjects.com
Base Domain encyclobjects.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-03T20:19:25+00:00
Next Scan 2025-06-01T20:19:25+00:00

Last Successful Scan

Scanned2024-11-04T03:25:53+00:00
URL https://encyclobjects.com/robots.txt
Domain IPs 104.21.49.100, 172.67.161.157, 2606:4700:3034::6815:3164, 2606:4700:3034::ac43:a19d
Response IP 172.67.161.157
Found Yes
Hash 6d46235836f06e39c07ba308f99f5aaf56a07b551e46d6f17fe943184459ae3f
SimHash 3314e050c830

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /?s=
Disallow /search

compspybot
curious george
cybeye.com
docomo
exb language crawler
ezooms
flamingo_searchengine
genieo
genio
lwnutch
lexxebot
openwebindex
rediffnewsbot
seoengworldbot
scanmine
screaming frog seo spider
shopwiki
showyoubot
sosospider
wocbot
yeti
yeti
youdaobot
daumoa
gsa-crawler
libcrawl
linkdex
magpie-crawler
repparser
rogerbot
sindice-site-manager
sogou spider
sogou
woriobot
yacybot
yolinkbot
amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

chatgpt

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://encyclobjects.com//sitemap.xml

Comments

  • Reglas tipicas para WordPress
  • Bots chungos o que consumen ancho de banda
  • No queremos regalar contenido a la IAs de ChatGPT y similares