Changing Email provider

I recently created a new website. Before connecting it to my domain, I have to also update my email info (connected to same domain), which requires MX records from the current email provider. But I’m wondering, what would happen if I just got a new email provider? Would I still be able to access my old emails through my old account, but just not receive new emails? What would happen to my old accounts exactly?