Fatal Error after installing plug-in help!

I just installed the WP ReviewHUB plug-in and it immediately gave my site the “fatal error” message.

I now cannot log in to the dashboard. I have tried logging into my FTP so I can rename the plug-in folder but its not giving me the option when I right click…

Can someone help a noob out? Pretty nervous that I can’t access my site!