Germany were put under immense pressure from a Netherlands side seeking a winner but the visitors snatched victory in the 90th minute through Nico Schulz.
Belgium earned a battling 3-1 win over Russia in Brussels as Eden Hazard struck twice for Roberto Martinez's side.
Both Premier League clubs Arsenal and Chelsea were initially drawn to be at home in the first leg.
Eden Hazard said is happy at Chelsea and agrees with manager Maurizio Sarri over his tactics.
Gonzalo Higuain showed why he has a stellar scoring record over the past decade in Spanish and Italian football with two excellent finishes to open his Premier League account.
Premier League: Tottenham Strike Late Again To Climb Above Manchester City, Chelsea Back In Top Four
Tottenham Hotspur beat Newcastle United 1-0 while London rivals Chelsea outclassed Huddersfield 5-0.
Chelsea prevailed 4-2 in the shootout at Stamford Bridge to set up a final meeting with holders Manchester City on February 24th.
Chelsea remain in fourth place, but they are now just three points ahead of fifth placed Arsenal in the race to qualify for next season's Champions League.
N'Golo Kante scored the lone goal of the match for Chelsea in the 51st minute.
Eden Hazard scored his 100th and 101st Chelsea goals as Maurizio Sarri's men moved back into the Premier League top four by grinding out a 2-1 win at Watford on Boxing Day.
Eden Hazard provided his ninth assist of the season for Pedro Rodriguez to open the scoring and then chalked up his ninth goal of the campaign.
Eden Hazard's present deal runs till June 2020.
Goals from Pedro and Ruben Loftus-Cheek helped Chelsea beat Fulham 2-0 in the Premier League on Sunday.
Eden Hazard has said he is in a quandary about whether to extend his deal or seek a "dream" move to Real Madrid.
Roberto Martinez's men saw their six-match unbeaten run since reaching the World Cup semi-finals brought to an shuddering halt.
Arsenal take on Sporting CP while Chelsea take on Bate Borisov in their Europa League encounters.
Ross Barkley's 96th-minute equaliser helped Chelsea maintain an unbeaten record under Maurizio Sarri.
Jose Mourinho pointed to the precedents for Chelsea being crowned champions in seasons when Eden Hazard is at his best.
