After Swift expressed her support, respondents said they were “somewhat” or “much less likely” to vote for Harris.