President Donald Trump has banned former Central Intelligence Agency director John Brennan from all federal buildings.