Yeah, that was my first thought too. But that's not the case.
Everything works fine in normal CGI mode (except that it's really slow) but as soon as I chance htaccess to use dispatch.fcgi Rails can't find the public folder anymore. When I switch back to dispatch.cgi it works fine again.
I can't believe no one else has had this problem , it happens with all my sites.