The Celtic player capped a standout defensive performance by turning home an in-swinging corner from Paul Hartley at Hampden Park.
The result maintained Scotland's perfect start to its Group B campaign with nine points from three games. World Cup runner-up France remains with six points.
It was also the first time in 14 years that France had lost a qualifying game on the road. Since a 2-0 loss to Bulgaria on Sept. 8, 1992, France had won 13 qualifying games away from home and drawn seven.
Scotland's decision to field only one striker handed France the chance to take complete control, even at Hampden Park. Because James McFadden had virtually no support, the French kept winning back possession to launch attack after attack on the Scottish defense and should have been two goals ahead by halftime.
Thierry Henry curled a 22-meter (yard) free kick that struck the far post, and both Patrick Vieira and David Trezeguet had goals called back for offsides.
Florent Malouda just missed the angle of the post and bar and then the French put together more than 20 passes inside the Scots' half with the home side chasing the ball.
The only first-half chance that fell to the Scots came in the 47th when Hartley's corner found Caldwell but his long-range header was easily saved by France goalkeeper Gregory Coupet.
The Scots looked different in the second half and McFadden almost gave them the lead three minutes after the break when he took a pass from Darren Fletcher and held off two defenders before shooting wide.
Although Louis Saha's inclusion in the France squad had angered Manchester United manager Alex Ferguson, who said he had hamstring and groin injuries, Raymond Domenech sent him on as a 61st-minute substitute for Trezeguet. Ferguson was watching from the stands.
The first goal came at the other end, however, when the rejuvenated Scots forced two corners in quick succession and Caldwell slid the ball home.
It should have been 2-0 in the 79th when Barry Ferguson broke down the left and fed the ball forward to the unmarked Hartley, but the Hearts midfielder was unable to control it with only Coupet to beat.
Source: Fox Sports 
Linear Mode
