Immigration policy, once expected to be an election-defining issue, has fallen among voters’ concerns.