zierfischforum.at
robots.txt

Robots Exclusion Standard data for zierfischforum.at

Resource Scan

Scan Details

Site Domain zierfischforum.at
Base Domain zierfischforum.at
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-29T19:22:29+00:00
Next Scan 2025-11-27T19:22:29+00:00

Last Successful Scan

Scanned2025-05-02T19:20:51+00:00
URL https://zierfischforum.at/robots.txt
Redirect https://www.zierfischforum.at/robots.txt
Redirect Domain www.zierfischforum.at
Redirect Base zierfischforum.at
Domain IPs 172.66.40.207, 172.66.43.49
Redirect IPs 172.66.40.207, 172.66.43.49
Response IP 172.66.43.49
Found Yes
Hash 37468fa5cddb678c371d6c8b651b0a766613ee2899aa24fcd501156ec4ab4309
SimHash 213ec270a0e1

Groups

boardreader

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

spinn3r

Rule Path
Disallow /

*

Rule Path
Disallow /cdn-cgi/
Disallow /includes/
Disallow /members/
Disallow /install/
Disallow /customavatars/
Disallow /customprofilepics/
Disallow /admincp/
Disallow /modcp/
Disallow /vbmembermap/
Disallow /1006223/
Disallow /members/
Disallow /online/
Disallow /recent-activiy/
Disallow /find-new/
Disallow /misc/
Disallow /hilfe/
Disallow /search/
Disallow /posts/
Disallow /tags/
Disallow /affiliate/
Disallow /account/

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.zierfischforum.at/sitemap.php

Warnings

  • 2 invalid lines.