avantgarde-experts.de
robots.txt

Robots Exclusion Standard data for avantgarde-experts.de

Resource Scan

Scan Details

Site Domain avantgarde-experts.de
Base Domain avantgarde-experts.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-08-30T14:53:17+00:00
Next Scan 2025-09-13T14:53:17+00:00

Last Successful Scan

Scanned2025-07-23T14:16:47+00:00
URL https://avantgarde-experts.de/robots.txt
Redirect https://www.yer.de/robots.txt
Redirect Domain www.yer.de
Redirect Base yer.de
Domain IPs 34.241.191.143, 34.248.104.12, 52.210.208.94
Redirect IPs 34.241.191.143
Response IP 34.241.191.143
Found Yes
Hash 6566a5bfa747a09d7f9ad50fbf4a69ae90481e5d54d08c5fe54512ac40cd7b57
SimHash a1d952abcef3

Groups

*

Rule Path
Disallow /typo3/
Disallow /typo3conf/
Allow /
Allow /typo3conf/ext/
Allow /typo3temp/
Allow /typo3/sysext/frontend/Resources/Public/*

israbot

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

*

Rule Path
Disallow /?q*
Disallow /?allLanguages*
Disallow /?alllanguages*
Disallow /?job_intern*
Disallow /?recommendations*

linkedinbot
facebookexternalhit
facebookbot
adsbot-google

Rule Path
Allow /
Disallow /typo3/
Disallow /typo3conf/

Other Records

Field Value
sitemap https://www.yer.de/de/sitemap.xml
sitemap https://www.yer.de/en/sitemap.xml