rockcamp.es
robots.txt

Robots Exclusion Standard data for rockcamp.es

Resource Scan

Scan Details

Site Domain rockcamp.es
Base Domain rockcamp.es
Scan Status Ok
Last Scan2024-10-02T00:08:34+00:00
Next Scan 2024-10-09T00:08:34+00:00

Last Scan

Scanned2024-10-02T00:08:34+00:00
URL https://rockcamp.es/robots.txt
Redirect https://www.rockcamp.es/robots.txt
Redirect Domain www.rockcamp.es
Redirect Base rockcamp.es
Domain IPs 104.21.35.199, 172.67.179.25, 2606:4700:3033::ac43:b319, 2606:4700:3035::6815:23c7
Redirect IPs 104.21.35.199, 172.67.179.25, 2606:4700:3033::ac43:b319, 2606:4700:3035::6815:23c7
Response IP 104.21.35.199
Found Yes
Hash 4269794e8600d26f6df48109bb41aa898916d4faa4f62a8406f08b7ff6bee540
SimHash 9b568010c830

Groups

*

Rule Path
Disallow /?oferta613

compspybot
curious george
cybeye.com
docomo
exb language crawler
ezooms
flamingo_searchengine
genieo
genio
lwnutch
lexxebot
openwebindex
rediffnewsbot
seoengworldbot
scanmine
screaming frog seo spider
shopwiki
showyoubot
sosospider
wocbot
yeti
yeti
youdaobot
daumoa
gsa-crawler
libcrawl
linkdex
magpie-crawler
repparser
rogerbot
sindice-site-manager
sogou spider
sogou
woriobot
yacybot
yolinkbot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.rockcamp.es/sitemap.xml

Comments

  • Todos esos robots chungos (o que consumen mucho ancho de banda)

Warnings

  • 1 invalid line.