escapadafindesemana.org
robots.txt

Robots Exclusion Standard data for escapadafindesemana.org

Resource Scan

Scan Details

Site Domain escapadafindesemana.org
Base Domain escapadafindesemana.org
Scan Status Ok
Last Scan2024-11-12T07:28:47+00:00
Next Scan 2024-11-19T07:28:47+00:00

Last Scan

Scanned2024-11-12T07:28:47+00:00
URL https://escapadafindesemana.org/robots.txt
Domain IPs 104.21.75.137, 172.67.177.118, 2606:4700:3031::ac43:b176, 2606:4700:3035::6815:4b89
Response IP 172.67.177.118
Found Yes
Hash 6bc6cb73cd89d106b409dbaa6633c9f45d75ceca45549f5d925dcf434bf884ea
SimHash 9156f330ca72

Groups

compspybot
curious george
cybeye.com
docomo
exb language crawler
ezooms
flamingo_searchengine
genieo
genio
lwnutch
lexxebot
openwebindex
rediffnewsbot
seoengworldbot
scanmine
screaming frog seo spider
shopwiki
showyoubot
sosospider
wocbot
yeti
yeti
youdaobot
daumoa
gsa-crawler
libcrawl
linkdex
magpie-crawler
repparser
rogerbot
sindice-site-manager
sogou spider
sogou
woriobot
yacybot
yolinkbot
yisouspider
linkscrawler
easouspider

Rule Path
Disallow /

baiduspider
baiduspider-image
baiduspider-video
baiduspider-news
baiduspider-favo
baiduspider-cpro
baiduspider-ads
baidu
baiduspider+

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Allow /wp-includes/js

Comments

  • Baiduspider

Warnings

  • 1 invalid line.