scifi-forum.de
robots.txt

Robots Exclusion Standard data for scifi-forum.de

Resource Scan

Scan Details

Site Domain scifi-forum.de
Base Domain scifi-forum.de
Scan Status Ok
Last Scan2024-09-28T07:43:28+00:00
Next Scan 2024-10-05T07:43:28+00:00

Last Scan

Scanned2024-09-28T07:43:28+00:00
URL https://scifi-forum.de/robots.txt
Redirect https://www.scifi-forum.de/robots.txt
Redirect Domain www.scifi-forum.de
Redirect Base scifi-forum.de
Domain IPs 85.214.224.112
Redirect IPs 85.214.224.112
Response IP 85.214.224.112
Found Yes
Hash 3164524cf45dc4ce1af30cecb3cec2835f5413648579724c52d234a415d775e7
SimHash 0c3d58a403d3

Groups

googlebot

Rule Path
Disallow /member/

wget

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

e-societyrobot

Rule Path
Disallow /

boardtracker

Rule Path
Disallow /

forenfreund

Rule Path
Disallow /

*

Rule Path
Disallow /advanced_search/
Disallow /privatemessage/
Disallow /uploader/
Disallow /*r%3D*
Disallow /new-content/