Smith suffered the injury playing for the Cheetahs in February, and informed Springboks coach Peter de Villiers on Wednesday that he was not fit enough for consideration.
De Villiers said: "Juan had been in a race against time to be fit and we were keen to give him every opportunity to prove himself available.
"He is understandably very disappointed - as are we - but he has made the right decision. A fully-fit Juan Smith would have been an enormous asset to our campaign and this is a major disappointment.
"But it was obvious that he was still some way from full fitness and his decision confirms the advice of our medical team. Out of respect for a great Springbok, we wanted to leave the door open until the last moment for him."
Smith, who has featured in 69 Tests for his country, said: "I've worked very hard to get back on the training field but I'm still some way from full fitness and have been training with quite a lot of pain. I'd been trying to tell myself that I'd come right but that wasn't going to happen.
"This is a huge blow to me. The Rugby World Cup is the pinnacle of any player's career and I was looking forward to our attempt to become the first team to win the title in successive tournaments."
The South Africa squad will be named on Tuesday evening.
Gilbert has released a new line of rugby cleats. The Gilbert Virtuo 8S is part of the exciting new product. Check it out.
The entire All Blacks apparel line has been updated for 2013/14. Check out the New Zealand All Blacks polo.
The Nike Tiempo is a solid rugby cleat and one of few styles still made from full-grain natural leather.
The Gilbert Blitz 8S rugby cleat is a great cleat at a great price of $69.99. Get a new pair of cleats today.
A cool looking all black rugby cleat with the high performance adidas is known for. Get in the Gear!
Wear the crest of the British and Irish Lions on your t-shirt. A great look for the summer.
$29.99
The All Blacks Performance t-shirt is black with hints of blue from the training jersey. Very Cool.
The New Zealand All Blacks training jersey for 2013/14. Get in the Gear!
The USA Rugby Pro Alternate rugby jersey is perfect for any fan of the Eagles. Get yours to wear during the summer Test matches.
The NEW All Blacks 2013/14 jersey has arrived at World Rugby Shop. Dare to wear the colors of the All Blacks.