You should try to destroy the enemy cultural structures so that they won't incite any more "rebellion". You don't have to full out attract the planet if your fleet's not ready, just send a decent amount frigates and order them to attack cultural structures After that some make your own so that you could a)keep enemy culture out and/or b)make them lose their planets. 
