Does it matter what color the wedding dress is?

This will be my second marriage. Do I have to wear white or ivory or can I wear any color dress on my wedding day? I'm looking for a tea length wedding dress or even just a nice dress for that day. Nothing extravagant or formal.