fondsweb.com
robots.txt

Robots Exclusion Standard data for fondsweb.com

Resource Scan

Scan Details

Site Domain fondsweb.com
Base Domain fondsweb.com
Scan Status Ok
Last Scan2025-12-06T11:38:06+00:00
Next Scan 2026-01-05T11:38:06+00:00

Last Scan

Scanned2025-12-06T11:38:06+00:00
URL https://fondsweb.com/robots.txt
Redirect https://www.fondsweb.com/robots.txt
Redirect Domain www.fondsweb.com
Redirect Base fondsweb.com
Domain IPs 104.26.4.110, 104.26.5.110, 172.67.68.107, 2606:4700:20::681a:46e, 2606:4700:20::681a:56e, 2606:4700:20::ac43:446b
Redirect IPs 104.26.4.110, 104.26.5.110, 172.67.68.107, 2606:4700:20::681a:46e, 2606:4700:20::681a:56e, 2606:4700:20::ac43:446b
Response IP 104.26.4.110
Found Yes
Hash 6e33ef826f70e11d4095fd89707c64d413baaf7d2e8c22339ee29e9fa02d6f14
SimHash 258093701371

Groups

mediapartners-google
adsbot-google-mobile
adsbot-google

Rule Path
Disallow

googlebot
googlebot-mobile
googlebot-news
duckduckbot
slurp

Rule Path
Disallow /ws/
Disallow /wsc/
Disallow /img/
Disallow /de/vergleichen
Disallow /at/vergleichen
Disallow /ch/vergleichen
Disallow /de/watchlist
Disallow /at/watchlist
Disallow /ch/watchlist
Disallow /de/user
Disallow /at/user
Disallow /ch/user
Disallow /de/suchen
Disallow /at/suchen
Disallow /ch/suchen

bingbot
bingpreview
msnbot
msnbot-media

Rule Path
Disallow /ws/
Disallow /wsc/
Disallow /img/
Disallow /de/vergleichen
Disallow /at/vergleichen
Disallow /ch/vergleichen
Disallow /de/watchlist
Disallow /at/watchlist
Disallow /ch/watchlist
Disallow /de/user
Disallow /at/user
Disallow /ch/user
Disallow /de/suchen
Disallow /at/suchen
Disallow /ch/suchen

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /