Log In Sign Up

bvz.at
robots.txt

Robots Exclusion Standard data for bvz.at

Resource Scan

Scan Details

Site Domain bvz.at
Base Domain bvz.at
Scan Status Ok
Last Scan2024-11-01T13:11:44+00:00
Next Scan 2024-11-08T13:11:44+00:00

Last Scan

Scanned2024-11-01T13:11:44+00:00
URL https://bvz.at/robots.txt
Redirect https://www.bvz.at/robots.txt
Redirect Domain www.bvz.at
Redirect Base bvz.at
Domain IPs 34.89.253.190
Redirect IPs 34.120.7.176
Response IP 34.120.7.176
Found Yes
Hash c074d82a7205d10fa12897563ac71d9735a66ad889e2a8df3ddfb75930682f76
SimHash 581cdd50c8c0

Groups

ccbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

flamingo_searchengine

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

*

Rule Path
Disallow /archiv/*
Disallow /content/*
Disallow /tags/*
Disallow /orte/*
Disallow /autor/*
Disallow /*/print$
Disallow /_ajax/*
Back to top

Other Records

Field Value
sitemap https://www.bvz.at/sitemapnews.xml
sitemap https://www.bvz.at/sitemapindex.xml
Back to top