furche.at
robots.txt

Robots Exclusion Standard data for furche.at

Resource Scan

Scan Details

Site Domain furche.at
Base Domain furche.at
Scan Status Ok
Last Scan2024-11-10T20:59:54+00:00
Next Scan 2024-11-17T20:59:54+00:00

Last Scan

Scanned2024-11-10T20:59:54+00:00
URL https://furche.at/robots.txt
Redirect https://www.furche.at/robots.txt
Redirect Domain www.furche.at
Redirect Base furche.at
Domain IPs 193.25.220.177
Redirect IPs 193.25.220.177
Response IP 193.25.220.177
Found Yes
Hash 7c765cb72e4b27f5c35b1861ab479e023d1149878524a8588057e92abee97869
SimHash f2689941c7e7

Groups

ai2bot
ai2bot-dolma
amazonbot
applebot
applebot-extended
bytespider
ccbot
chatgpt-user
claude-web
claudebot
diffbot
facebookbot
friendlycrawler
gptbot
google-extended
googleother
googleother-image
googleother-video
icc-crawler
isscyberriskcrawler
imagesiftbot
kangaroo bot
meta-externalagent
meta-externalfetcher
oai-searchbot
perplexitybot
petalbot
scrapy
sidetrade indexer bot
timpibot
velenpublicwebcrawler
webzio-extended
youbot
anthropic-ai
cohere-ai
iaskspider/2.0
img2dataset
omgili
omgilibot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.furche.at/sitemap.xml

Comments

  • Legal Notice:
  • All rights are reserved. The usage of contents of this website and/or of website data
  • for the purpose of text and data mining in the meaning of § 42h (6) of the Austrian
  • Copyright Act is not permitted for the training of AI (artificial intelligence) models
  • and/or AI based technologies. DIE FURCHE - Zeitschriften-Betriebsgesellschaft m.b.H. & CoKG
  • may change this Legal Notice at any time at its sole discretion."