flow.es
robots.txt

Robots Exclusion Standard data for flow.es

Resource Scan

Scan Details

Site Domain flow.es
Base Domain flow.es
Scan Status Ok
Last Scan2024-09-28T18:47:09+00:00
Next Scan 2024-10-28T18:47:09+00:00

Last Scan

Scanned2024-09-28T18:47:09+00:00
URL https://flow.es/robots.txt
Domain IPs 35.214.170.225
Response IP 35.214.170.225
Found Yes
Hash 3c5b65acfe38b29247cfab3d8e3d906dda65f0a23d29fd5bc578dd346315f61d
SimHash 6b76e410c830

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /xml-rpc.php
Disallow /?s=
Disallow /search
Disallow wordfence_logHuman
Disallow /aviso-legal
Disallow /politica-de-cookies
Disallow /politica-de-privacidad/
Disallow /hola-mundo

Other Records

Field Value
crawl-delay 10

compspybot
curious george
cybeye.com
docomo
exb language crawler
ezooms
flamingo_searchengine
genieo
genio
lwnutch
lexxebot
openwebindex
rediffnewsbot
seoengworldbot
scanmine
screaming frog seo spider
shopwiki
showyoubot
sosospider
wocbot
yeti
youdaobot
daumoa
gsa-crawler
libcrawl
linkdex
magpie-crawler
repparser
rogerbot
sindice-site-manager
sogou spider
sogou
woriobot
yacybot
yolinkbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://flow.es/sitemap.xml

Comments

  • Robots que consumen mucho ancho de banda)