All I needed to do was set my web directory (e.g. /home/username/sitedir/app/webroot) and then upload my CakePHP app files into sitedir. Then just create your database and enter the settings into app/config/database.php and you should be up and running.
The only challenge I've run into is getting to the stats pages. Cake keeps wanting to redirect to the sites homepage.