Can I cancel a purchase order I no longer want?

Yes, with Cancel the order. A cancelled order is closed and cannot be received, so nothing lands on the shelf by accident later. It stays visible in your list rather than disappearing, and the ingredients it was holding stop counting as on order, so the Reorder column asks for them again.