antispameurope.com
robots.txt

Robots Exclusion Standard data for antispameurope.com

Resource Scan

Scan Details

Site Domain antispameurope.com
Base Domain antispameurope.com
Scan Status Ok
Last Scan2024-05-23T05:57:03+00:00
Next Scan 2024-06-06T05:57:03+00:00

Last Scan

Scanned2024-05-23T05:57:03+00:00
URL https://antispameurope.com/robots.txt
Redirect https://www.hornetsecurity.com/robots.txt
Redirect Domain www.hornetsecurity.com
Redirect Base hornetsecurity.com
Domain IPs 174.142.136.190
Redirect IPs 194.6.209.34
Response IP 194.6.209.34
Found Yes
Hash 3546fe80039640ec3b9edc43653e95991a71051a1be27f218056b06f9ab206cc
SimHash aa3813c04ee3

Groups

*

Rule Path
Disallow /livechat/
Disallow /wp-admin/
Disallow /wp-static-data/business-card/
Disallow /de/?s=
Disallow /en/?s=
Disallow /es/?s=
Disallow /?s=
Disallow /search/
Disallow /de/search/
Disallow /en/search/
Disallow /es/search/
Disallow /downloads/
Disallow /data/downloads/reports
Disallow /de/html-cp-manual
Disallow /en/html-cp-manual
Disallow /es/html-cp-manual
Disallow /nl/html-cp-manual
Disallow /de/html-cp-manual-whitelabel
Disallow /en/html-cp-manual-whitelabel
Disallow /es/html-cp-manual-whitelabel
Disallow /nl/html-cp-manual-whitelabel

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

majesticseo

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

xovi

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

search17

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

slysearch

Rule Path
Disallow /

findlinks

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

lb-spider

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

huaweisymantecspider

Rule Path
Disallow /

ec2linkfinder

Rule Path
Disallow /

htdig

Rule Path
Disallow /

discobot

Rule Path
Disallow /

linkdex.com

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

edisterbot

Rule Path
Disallow /

swebot

Rule Path
Disallow /

picmole

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yeti-mobile

Rule Path
Disallow /

pagepeeker

Rule Path
Disallow /

catchbot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

netestatenecrawler

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

comodosslchecker

Rule Path
Disallow /

comodo-certificates-spider

Rule Path
Disallow /

gonzo

Rule Path
Disallow /

schrein

Rule Path
Disallow /

afiliaswebminingtool

Rule Path
Disallow /

suggybot

Rule Path
Disallow /

bdbrandprotect

Rule Path
Disallow /

bpimagewalker

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

lex

Rule Path
Disallow /

contentcrawler

Rule Path
Disallow /

dcpbot

Rule Path
Disallow /

kaloogabot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

icjobs

Rule Path
Disallow /

obot

Rule Path
Disallow /

webmastercoffee

Rule Path
Disallow /

qualidator

Rule Path
Disallow /

webinator

Rule Path
Disallow /

scooter

Rule Path
Disallow /

thunderstone

Rule Path
Disallow /

larbin

Rule Path
Disallow /

opidoobot

Rule Path
Disallow /

ips-agent

Rule Path
Disallow /

tineye

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

unister

Rule Path
Disallow /

reverseget

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.hornetsecurity.com/page-sitemap.xml
sitemap https://www.hornetsecurity.com/post-sitemap.xml

Comments

  • Interne Suche nicht indexieren
  • Disallow: /wp-content/uploads/
  • jedoch *.png erlauben
  • Allow: /wp-content/uploads/*.png$
  • Allow: /wp-content/uploads/*.pdf$
  • Reports nicht indexieren
  • Handbuch nicht indexieren

Warnings

  • 2 invalid lines.