bebac.at
robots.txt

Robots Exclusion Standard data for bebac.at

Resource Scan

Scan Details

Site Domain bebac.at
Base Domain bebac.at
Scan Status Ok
Last Scan2025-12-24T00:46:53+00:00
Next Scan 2026-01-23T00:46:53+00:00

Last Scan

Scanned2025-12-24T00:46:53+00:00
URL https://bebac.at/robots.txt
Domain IPs 104.21.27.134, 172.67.142.160, 2606:4700:3034::6815:1b86, 2606:4700:3035::ac43:8ea0
Response IP 104.21.27.134
Found Yes
Hash 1d7be796229c6742e936640b5ce746afc43b0df13bbe6f97588e95131089d59a
SimHash 53341c21dc14

Groups

baiduspider
googlebot-news
mj12bot
ahrefsbot
seoscanners
linkdexbot
petalbot
lcc
semrushbot
blexbot
facebookbot
amazonbot
bytespider
wormlybot
dotbot

Product Comment
mj12bot 2017-02-08
ahrefsbot 2017-02-09
seoscanners 2017-02-09
linkdexbot 2017-02-10
petalbot 2020-09-20
lcc 2020-09-22
semrushbot 2020-09-22
blexbot 2020-09-22
facebookbot 2024-06-11; however, ignored by bloody FB!
amazonbot 2024-06-15
bytespider 2024-06-15
wormlybot 2024-06-16
dotbot 2024-06-16
Rule Path
Disallow /

ccbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 45

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 25

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 300

claudebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

*

Rule Path
Disallow /downloads/
Disallow /emff_0.5.8/
Disallow /news/newsmenu.inc.php
Disallow *ContactTime.inc.php
Disallow geshi.php
Disallow /pdfs/
Disallow /pics/
Disallow /scripts/
Disallow /transfer/
Disallow *doc.kml
Disallow /working/
Disallow /articles/libs/

Other Records

Field Value
crawl-delay 3600

Other Records

Field Value
sitemap http://bebac.at/sitemap.xml

Comments

  • times are seconds
  • Commented out since google lamments (why the heck?)
  • Disallow: /graphics/