ifs-kiel.de
robots.txt

Robots Exclusion Standard data for ifs-kiel.de

Resource Scan

Scan Details

Site Domain ifs-kiel.de
Base Domain ifs-kiel.de
Scan Status Ok
Last Scan2025-09-25T13:00:50+00:00
Next Scan 2025-10-25T13:00:50+00:00

Last Scan

Scanned2025-09-25T13:00:50+00:00
URL https://ifs-kiel.de/robots.txt
Redirect https://www.ifs-ev.org/robots.txt
Redirect Domain www.ifs-ev.org
Redirect Base ifs-ev.org
Domain IPs 188.40.64.152, 2a01:4f8:221:525::3
Redirect IPs 188.40.64.152, 2a01:4f8:221:525::3
Response IP 188.40.64.152
Found Yes
Hash da57094ceac6788f6f956a42e0bfd2a8684a9cfbfec5d82c6356289468060784
SimHash 7031195b2321

Groups

ai-bot

Rule Path
Disallow /

laion

Rule Path
Disallow /

openai

Rule Path
Disallow /

midjourney

Rule Path
Disallow /

stabilityai

Rule Path
Disallow /

runwayml

Rule Path
Disallow /

imagescraper

Rule Path
Disallow /

dataminer

Rule Path
Disallow /

dataminingbot

Rule Path
Disallow /

dataminerbot

Rule Path
Disallow /

picturescraper

Rule Path
Disallow /

ai-trainingbot

Rule Path
Disallow /

aidatacollector

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

newsnow

Rule Path
Disallow /

news-please

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

peer39_crawler
peer39_crawler/1.0

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

Comments

  • Any form of picture scraping or data mining is strictly prohibited.
  • Disallow Rules (NYT)