Is there a limit on option groups per item?

No hard limit that a real menu hits. If an item needs more than three or four groups, consider splitting it into variants — customers choose faster.