404 when file has non-latin characters in it

I get a 404 when a file or the path has non-Latin characters in it. Examples:

http://example.com/Århus/some_image.jpg http://example.com/beer/øl.jpg

Both of these result in a 404 even though I know the path exists. The access logs say this (for the top one above):

What I actually see in the browser’s 404 message is this:

which is why it’s resulting in a 404 - the “Å” character is being turned into something else. I tried adding this to my .htaccess file to no avail:

Any ideas how to get the server to comply with UTF-8 file paths?