President Trump announced Saturday that White House chief of staff John Kelly would be leaving the administration by the end of the year.