Is closing the connection after each static object a wise choice?
Amazon uses keep-alive for good reason.
Also, what is with using Apache to serve, certainly that is not going to scale to the levels you need?
If you are using apache though, you could set keep-alive with a one or two second timeout. That will give it a chance to reuse the connection if there is another object on a page.