If you simply remove the current power and do not fill the vacuum, someone else will do it for you -- no doubt those who supported his rise in the first place.

[Surprisingly, he seems rather unaffected by the call-out. Its exactly what the First Order did after the Empire was removed.

Sure, it took them 30 years, but it worked.]