Did you install WordPress via One Click?
Judging from your site, there’s not much content yet, so starting over wouldn’t be such a bad idea. Just keep a backup of your site (especially the theme) and re-do the One Click install in the / directory. Then restore the old components from the backup.
By the way, that’s a neat MP3 player plugin. What is it?