I am rather shocked that so many of you think the OP should just have kept the wine.
No company is going to avoid mistakes if they are never told that they made them.
The driver probably does not have the standing in the firm that gives him the right to say OP should have kept them, and when the person who did order them, if such a person exists, complains that they were missing from her order, obviously the driver is not likely to say "Oh I told Mrs. N. just to keep them, as they were in her order."
Another point leaps to mind: whose account were these bottles of wine charged to?
If OP has to pay for them then she decides whether to accept and pay for them, or whether to demand that the price be deducted from her bill and the goods returned.
To me OP is right in saying it would be dishonest to keep them, which presumably means they were not on her bill. Keeping or using stolen goods is a legal offence, as is actually stealing them.
Surely you can see that if we all just kept things sent to us by mistake, the price of goods would rise, as the companies concerned are being cheated of the price of these goods?
So even if thieving or receiving stolen goods does not bother you, common sense should dictate that you don't keep something sent to you by mistake.