"I'd love to get the guy currently in there out... but people are holding me back," he said, referring to Fed's Jerome Powell.