Do I have to mark orders delivered for stamps to work?

No. Orders you mark delivered earn straight away, and two timers catch the ones nobody closed. Both sit on the Loyalty and stamps page under When an order counts, and both are in minutes. Set them to 1 while you are testing and watch a stamp land. A timer running out never marks an order delivered and never changes a report.