How do I change the message customers see when we're closed?

Settings → Closed page: a message up to 120 characters plus three colours (blank keeps your layout's default). Use "Preview closed page ↗" to check it — the preview works while you are open and only signed-in staff can see it.