Dedicated lines for British passport holders at UK airports would lead to longer queues, according to a Home Office minister.