It could be broken in some combos, like Altar+ Karavox (all that influence)
Also it could create a slippery slope situation, especially among players.
One side effect balance issue: do Karavox's Silver Tongue/Broken Loyalties abilities scale well costwise with Altar's influence abilities? Not sure how or if this can really be tested, and this may be an obscure balance case.