His standing with blue-collar workers is in serious danger.