bsv-fanforum.de
robots.txt

Robots Exclusion Standard data for bsv-fanforum.de

Resource Scan

Scan Details

Site Domain bsv-fanforum.de
Base Domain bsv-fanforum.de
Scan Status Ok
Last Scan2025-11-04T15:55:41+00:00
Next Scan 2025-12-04T15:55:41+00:00

Last Scan

Scanned2025-11-04T15:55:41+00:00
URL https://bsv-fanforum.de/robots.txt
Redirect https://www.bsv-fanforum.de/robots.txt
Redirect Domain www.bsv-fanforum.de
Redirect Base bsv-fanforum.de
Domain IPs 178.254.0.81
Redirect IPs 178.254.0.81
Response IP 178.254.0.81
Found Yes
Hash 00d6d96bc415f954e9304e924f3bb201a5590b1b5a53fe302aad6ce44d354a34
SimHash 5530c9e9e493

Groups

*

Rule Path
Disallow /members-list/
Disallow /search-result/
Disallow /trophy/
Disallow /user/
Disallow /recent-activity-list/
Disallow /team/
Disallow /trophy-list/
Disallow /users-online-list/
Disallow /lost-password/
Disallow /search/

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

Comments

  • Block Bots