argekultur.at
robots.txt

Robots Exclusion Standard data for argekultur.at

Resource Scan

Scan Details

Site Domain argekultur.at
Base Domain argekultur.at
Scan Status Ok
Last Scan2024-09-20T14:38:43+00:00
Next Scan 2024-10-20T14:38:43+00:00

Last Scan

Scanned2024-09-20T14:38:43+00:00
URL https://argekultur.at/robots.txt
Redirect https://www.argekultur.at/robots.txt
Redirect Domain www.argekultur.at
Redirect Base argekultur.at
Domain IPs 195.70.110.85
Redirect IPs 195.70.110.85
Response IP 195.70.110.85
Found Yes
Hash ee4a61aa3b95f3e1e3cf65350440b4c17e1b9deb21188c3548fa778bf4b7c1a1
SimHash f2886c926e9a

Groups

*

Rule Path
Disallow /lostandalone/
Disallow /downloads/presse/
Disallow /newsticker/
Disallow /Ars/Arge/Event/EventSearch.aspx
Disallow /Ars/Arge/Event/EventReport.aspx

baidu

Rule Path
Disallow /

backdoorbot

Rule Path
Disallow /

backdoorbot/1.0

Rule Path
Disallow /

baidubot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-render

Rule Path
Disallow /

buck

Rule Path
Disallow /

besserscheitern-crawl

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

detectify

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ecoresearch

Rule Path
Disallow /

link checker

Rule Path
Disallow /

link validator

Rule Path
Disallow /

linkalarm

Rule Path
Disallow /

linkbot

Rule Path
Disallow /

linkcheck by siteimprove.com

Rule Path
Disallow /

linkcheck scanner

Rule Path
Disallow /

linkchecker

Rule Path
Disallow /

magpie

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

mega-index

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot/2~bl

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

sogou

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

trendictionbot0.5.0

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

vebidoobot

Rule Path
Disallow /

wonderbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

yak

Rule Path
Disallow /

yandexantivirus

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.argekultur.at/sitemap.xml
sitemap https://www.argekultur.at/sitemap2.xml