CKEditor disable color pallets

Hi All, I am using version 3.5.4 of CKEditor and have a question regarding color pallets.
At my offices, we have removed most basic formatting tools from CKEditor because we want to control the way our pages look rather than the user doing something wacky.

I have noticed that there are ways to still muck up the the screen by using various color pallets buried in dialogs. For instance, if I add a table to the screen using the Table dialog, I can then right click on the cell, click cell properties and all of the sudden! I have a nice, color pallet that I can destroy the web with.

I would like to know what the easiest way to disable these dialogs is without loosing the capability to use, for instance, the Table.

I was guessing something like

CKEDITOR.config.colorButton_colors = '';

would work but I seem to be mistaken.

Thanks