"If the president were to succeed at this, that would mean every future chair is subject to removal at the whim of the president," said former general counsel for the Federal Reserve Scott Alvarez.