In a game ruined by the weather, Scotland refused to buckle in the face of a 35-minute siege in the second half before winning a penalty which Greig Laidlaw calmly converted.
"When we had the ball we made the most of it and eventually it came our way," captain Ross Ford said. "It was phenomenal. Australia are a great team and to win away from home is fantastic."
Lashing wind and rain made quality rugby virtually impossible and Scotland, who had the wind behind them in the first half, took charge.
However, their attack looked no more potent against the well-organised Australian defence than it had done in the Six Nations, when they could manage only four tries in five games.
As had been the case all season, Scotland made the breaks with Ross Rennie and Sean Lamont both going through, only for supporting players to spill the passes.
Although Laidlaw missed an early penalty, he did make amends to give Scotland the lead, but by then they had used up more than half their time with the elements behind them.
Laidlaw soon extended the lead with another penalty, but when full-back Stuart Hogg lost control of the ball as he tried to take a tricky low chip, it gave Australia the territory that they needed to collect their first points of the game.
Centre Mike Harris, who was making his debut, put over the kick after the Scotland backs strayed offside.
Scotland suffered a further blow when Lamont picked up a rib injury and was forced off, handing Edinburgh full-back Tom Brown his debut.
With the wind behind them in the second half Australia took instant advantage when Scotland failed to clear the kick-off and Ross Rennie was caught handling in the ruck.
Harris kicked his second penalty to level the scores less than two minutes into the second half.
Australia thought they had taken the lead when they managed to get Rob Simmons, the replacement lock, over the line after rejecting a kick at goal and opting for a lineout a few yards from the Scots line.
The decision went to the television match official but there were no camera angles that showed the ball and Scotland were given the benefit of the doubt.
That set up an extended period of intense Australian pressure as they had the ball consistently within five yards of Scotland's line, but the visitors' defence refused to yield an inch.
It was heroic stuff, but it was also a case of living dangerously with the lineout misfiring badly and preventing Scotland breaking the stranglehold.
Harris and Berrick Barnes both missed with long-range penalties for the home side, while Barnes also missed with an easier drop goal attempt.
Digby Ioane was the dangerman for Australia, but he was once called back for obstruction and the other time he got away he was well shackled by Brown.
Eventually, after making more than 150 tackles, Scotland managed to break the siege and get the ball into the opposition half.
A neat break from Laidlaw set up the attacking position, which went to a series of scrums before the referee lost patience with the Australian pack and handed Laidlaw a simple penalty chance which he gleefully converted.
Gilbert has released a new line of rugby cleats. The Gilbert Virtuo 8S is part of the exciting new product. Check it out.
The entire All Blacks apparel line has been updated for 2013/14. Check out the New Zealand All Blacks polo.
The Nike Tiempo is a solid rugby cleat and one of few styles still made from full-grain natural leather.
The Gilbert Blitz 8S rugby cleat is a great cleat at a great price of $69.99. Get a new pair of cleats today.
A cool looking all black rugby cleat with the high performance adidas is known for. Get in the Gear!
Wear the crest of the British and Irish Lions on your t-shirt. A great look for the summer.
$29.99
The All Blacks Performance t-shirt is black with hints of blue from the training jersey. Very Cool.
The New Zealand All Blacks training jersey for 2013/14. Get in the Gear!
The USA Rugby Pro Alternate rugby jersey is perfect for any fan of the Eagles. Get yours to wear during the summer Test matches.
The NEW All Blacks 2013/14 jersey has arrived at World Rugby Shop. Dare to wear the colors of the All Blacks.