A customer deleted their wallet card by accident — are stamps lost?

No — the card is a view. Re-add from the save link (post-checkout or from loyalty messages) and the same stamps are right there.