Log In Sign Up

selvbetjening.winkas.net
robots.txt

Robots Exclusion Standard data for selvbetjening.winkas.net

Resource Scan

Scan Details

Site Domain selvbetjening.winkas.net
Base Domain winkas.net
Scan Status Ok
Last Scan2/17/2025, 12:24:47 AM
Next Scan 3/19/2025, 12:24:47 AM

Last Scan

Scanned2/17/2025, 12:24:47 AM
URL https://selvbetjening.winkas.net/robots.txt
Domain IPs 104.45.12.69
Response IP 104.45.12.69
Found Yes
Hash 14952f31ac39c9239302eeaab903ed07b43b363ac70f9cf6648e02ced46dcb1c
SimHash db76f491cd80

Groups

*

Rule Path
Disallow /resbook-form.asp*
Disallow /resbook-create.asp*
Disallow /resapplication-edit.asp*
Disallow /resbook*?*customsearch*
Disallow /admin/

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

yahoo! slurp

Rule Path
Disallow /

yahoo!

Rule Path
Disallow /

yahoo

Rule Path
Disallow /

findxbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

netestate

Rule Path
Disallow /

sqlmap

Rule Path
Disallow /

siteimprove.com

Rule Path
Disallow /

linkcheck by siteimprove.com

Rule Path
Disallow /

linguee

Rule Path
Disallow /

linguee bot

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

sjuup

Rule Path
Disallow /

exabot

Rule Path
Disallow /

garlikcrawler

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

zoominfobot (zoominfobot at zoominfo dot com)

Rule Path
Disallow /

zoominfobot/nutch-1.12-snapshot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

extensa

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

xing-contenttabreceiver

Rule Path
Disallow /

xing

Rule Path
Disallow /

contenttabreceiver

Rule Path
Disallow /

hostharvest

Rule Path
Disallow /

seekport

Rule Path
Disallow /

seekport+crawler

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

seocompany.store

Rule Path
Disallow /

seocompany

Rule Path
Disallow /

spider@seocompany.store

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

sjuupbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

sogou+web+spider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

ccbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

sogou+web+spider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

daum

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

searchatlas

Rule Path
Disallow /

searchatlas.com

Rule Path
Disallow /

searchatlas.com seo crawler

Rule Path
Disallow /

accompanybot

Rule Path
Disallow /

alphabot

Rule Path
Disallow /

monsidobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

mj12bot

Rule Path
Disallow /

nimbostratus

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /
Disallow /

petalbot

Rule Path
Disallow /

seekport

Rule Path
Disallow /

seekport+crawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /
Back to top

Warnings

  • `brugeragent` is not a known field.
Back to top