Several may leave SD’s party board