I tried to run joomla on a basic ps, minimum settings, it just wasn't enough, great for a static site only. I think the best option is to use a vps from somewhere like tektonic, but you have to dabble in managing your own server. Doable if you don't have the knowledge, but you have to google alot to find the answers. Webmin is a good server manager and the website has good support.
Toiletrage.. a place for friends to bitch