You can't install gems into a public, shared directory. If you could, you could do things that would break other users who are hosted on the same machine as you.
I suggest the following:
1) do a gem list --local, and realize that rmagick along with many other things are already installed for you.
2) Add the following lines to your .bash_profile on your shell account:
3) Install gems as you wish.