2cvforum.de
robots.txt

Robots Exclusion Standard data for 2cvforum.de

Resource Scan

Scan Details

Site Domain 2cvforum.de
Base Domain 2cvforum.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-28T23:07:06+00:00
Next Scan 2025-11-26T23:07:06+00:00

Last Successful Scan

Scanned2025-05-01T20:46:55+00:00
URL https://2cvforum.de/robots.txt
Redirect https://www.2cvforum.de/robots.txt
Redirect Domain www.2cvforum.de
Redirect Base 2cvforum.de
Domain IPs 172.66.40.215, 172.66.43.41
Redirect IPs 172.66.40.215, 172.66.43.41
Response IP 172.66.43.41
Found Yes
Hash 34bcb704d44140150685d753fc0ab6162ae404c606f49174118347d9817eede6
SimHash 203bd050a431

Groups

boardreader

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

spinn3r

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow /cdn-cgi/
Disallow /account/
Disallow /affiliate/
Disallow /find-new/
Disallow /goto/
Disallow /hilfe/
Disallow /login/
Disallow /members/
Disallow /misc/
Disallow /online/
Disallow /posts/
Disallow /recent-activiy/
Disallow /register/
Disallow /search/
Disallow /tags/
Disallow /whats-new/
Disallow /watched/
Disallow /conversations/
Disallow /approval-queue/
Disallow /beitrag*.html
Disallow /feed/
Disallow /images/forum-proxy-store/
Disallow /threads/*/reply

meta-externalagent

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.2cvforum.de/sitemap.php

Warnings

  • 2 invalid lines.