Ben Youngs came off the bench to score the only try of Saturday's Pool B match after 68 minutes and Jonny Wilkinson's conversion nudged England into the lead for the first time.
England's discipline was poor and they were second best for much of the game.
Had the Pumas not missed a total of six penalty shots and a drop-goal, they could have been out of touch.
Argentina's points came from two Martin Rodriguez penalties and one from Felipe Contepomi, the influential fly-half who was forced off injured in the first half.
Wilkinson was equally poor in front of goal, sending five penalty shots wide, four of them in the second half as England sought a way back into the game.
But it was Youngs who provided England's 'get out of jail free' card.
The Leicester scrum-half, making his first appearance since undergoing knee surgery in the summer, scampered over from the base of a ruck to seal England the win.
Gilbert has released a new line of rugby cleats. The Gilbert Virtuo 8S is part of the exciting new product. Check it out.
The entire All Blacks apparel line has been updated for 2013/14. Check out the New Zealand All Blacks polo.
The Nike Tiempo is a solid rugby cleat and one of few styles still made from full-grain natural leather.
The Gilbert Blitz 8S rugby cleat is a great cleat at a great price of $69.99. Get a new pair of cleats today.
A cool looking all black rugby cleat with the high performance adidas is known for. Get in the Gear!
Wear the crest of the British and Irish Lions on your t-shirt. A great look for the summer.
$29.99
The All Blacks Performance t-shirt is black with hints of blue from the training jersey. Very Cool.
The New Zealand All Blacks training jersey for 2013/14. Get in the Gear!
The USA Rugby Pro Alternate rugby jersey is perfect for any fan of the Eagles. Get yours to wear during the summer Test matches.
The NEW All Blacks 2013/14 jersey has arrived at World Rugby Shop. Dare to wear the colors of the All Blacks.