How to customize the new insert div

The new insert div menu option is great - except I can't find any documentation on how to populate the combo box for inserting divs with different preset styles. I'd like to have 3 options to select from, one for inserting a simple notice box, and one each for left and right aligned divs that can contain images with caption text.

Anyone know how to do this?