Do failed numbers get retried forever?

No — failures are recorded, surfaced, and recently-failed numbers are excluded from marketing automatically. Dead numbers stop costing you reputation.