Any advice on starting a cupcake business?

I think your initial thoughts are great.

A farmers market is always a good way to see if people like your product and a great way to learn your costs, how much time is involved and of course how much profit you can make.

By the way, yes you will have to deal with the heat, both for keeping the cakes yourself and for your customers to take them home.