technik.gofeminin.de
robots.txt

Robots Exclusion Standard data for technik.gofeminin.de

Resource Scan

Scan Details

Site Domain technik.gofeminin.de
Base Domain gofeminin.de
Scan Status Ok
Last Scan2025-07-20T16:27:32+00:00
Next Scan 2025-08-19T16:27:32+00:00

Last Scan

Scanned2025-07-20T16:27:32+00:00
URL https://technik.gofeminin.de/robots.txt
Redirect https://forum.gofeminin.de/robots.txt
Redirect Domain forum.gofeminin.de
Redirect Base gofeminin.de
Domain IPs 104.26.2.212, 104.26.3.212, 172.67.74.140, 2606:4700:20::681a:2d4, 2606:4700:20::681a:3d4, 2606:4700:20::ac43:4a8c
Redirect IPs 104.26.2.212, 104.26.3.212, 172.67.74.140, 2606:4700:20::681a:2d4, 2606:4700:20::681a:3d4, 2606:4700:20::ac43:4a8c
Response IP 104.26.3.212
Found Yes
Hash e0655154b129815b904f4e56fd490f173b4b1f87db690e610db4c1486ec341ff
SimHash 7d564911c2c0

Groups

ai2bot
ai2bot-dolma
aihitbot
amazonbot
andibot
anthropic-ai
applebot
applebot-extended
awario
bedrockbot
brightbot 1.0
bytespider
ccbot
chatgpt-user
claude-searchbot
claude-user
claude-web
claudebot
cohere-ai
cohere-training-data-crawler
cotoyogi
crawlspace
datenbank crawler
devin
diffbot
duckassistbot
echobot bot
echoboxbot
factset_spyderbot
firecrawlagent
friendlycrawler
gemini-deep-research
google-cloudvertexbot
google-extended
googleother
googleother-image
googleother-video
gptbot
iaskspider/2.0
icc-crawler
imagesiftbot
img2dataset
isscyberriskcrawler
kangaroo bot
mistralai-user
mistralai-user/1.0
mycentralaiscraperbot
netestate imprint crawler
novaact
oai-searchbot
omgili
omgilibot
operator
pangubot
panscient
panscient.com
perplexity-user
perplexitybot
petalbot
phindbot
poseidon research crawler
qualifiedbot
quillbot
quillbot.com
sbintuitionsbot
scrapy
semrushbot-ocob
semrushbot-swa
sidetrade indexer bot
summalybot
thinkbot
tiktokspider
timpibot
velenpublicwebcrawler
wardbot
webzio-extended
wpbot
yandexadditional
yandexadditionalbot
youbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://forum.gofeminin.de/sitemap.xml

Comments

  • NOTICE: The collection of content and other data on this
  • site through automated means, including any device, tool,
  • or process designed to data mine or scrape content, is
  • prohibited except (1) for the purpose of search engine indexing or
  • with express written permission from this site’s operator.
  • To request permission to license our intellectual# property and/or other materials, please contact us directly.
  • BEGIN DBN Botlist — generated 2025-07-11 15:18 UTC
  • User-agent: FacebookBot # temporary removed for FB sharing
  • User-agent: facebookexternalhit # temporary removed for FB sharing
  • User-agent: meta-externalagent # temporary removed for FB sharing
  • User-agent: Meta-ExternalAgent # temporary removed for FB sharing
  • User-agent: meta-externalfetcher # temporary removed for FB sharing
  • User-agent: Meta-ExternalFetcher # temporary removed for FB sharing
  • END DBN Botlist