I think, when I consider the arguments against a virtual only debit card, they tend to mirror the arguments against app only banking from 5 years ago.
The solution for folks who don’t want this is exactly the same. Stick with your traditional bank.
I also think if legacy banks where to adopt a similar strategy, I don’t see them making you pay for a physical card like N26 and Revolut do. In fact I reckon they would remain free, you’d just need to ask for one rather than be given one as standard.
As for the infrastructure not being there yet, I’d actually disagree with that in every instance besides the need to withdraw cash. Now that I know Apple Pay and Google pay can be used for withdrawals, I think we ought to be upgrading our ATMs to support contactless too.