Just hit Fully Hosted again. That should fix any file permission errors within the structure, allowing you to remove the troublesome folder. If it still won’t delete, check to see if your user is listed as the owner of that .htaccess file and also check the permissions the user has on it (could be something glitched out and Support might need to remove it for you).
Maximum Cash Discount on any plan with MAXCASH
How To Install PHP.INI / ionCube on DreamHost