I'm not using version 9, but I don't think it's very different from version 8.10......
To 'empty' the Swatch tab, first I would set it to only display 'color' only (no gradients, patterns, or textures)On the bottom right of the Material palette there's a button to set what the Swatch tab displays.
Then you click on each color swatch and delete it (use the Trash icon button) until the they are all gone.
Now left click the Foreground color box, the Materials dialog pops up. Mouse over the color in the image you want to add, and left click, then use the "Add to swatches" button. Do this until you have all your colors set.
Hope that helps.......... if you have any other questions, don't hesitate to ask.