The former Jan 6 committee chair called the investigation a 'fishing expedition'