Majority wants to accept fewer refugees