The France international struck from the spot after Allan Nyom was penalised for sliding in on Wilfried Zaha on the left-hand edge of the penalty area.
Crystal Palace signed Yohan Cabaye has signed a three-year deal, subject to receiving international clearance, he will once again team up with manager Alan Pardew, under whom he played at Newcastle United during his previous stint in England.
Yohan Cabaye has won five trophies with PSG since signing from Newcastle United in January 2014, including successive Ligue 1 titles.
Newcastle have racked up impressive away victories at Tottenham and Manchester United in recent weeks and it was Yohan Cabaye, the returning match-winner from Old Trafford, who opened the scoring in the 25th minute.
Yohan Cabaye's goal just after the hour gave Newcastle their first victory at Old Trafford since 1972 and consigned United to back-to-back home defeats in the league for the first time since May 2002.
Gerrard reached the milestone with a 42nd-minute penalty in Saturday's 2-2 draw at St James' Park, cancelling out Yohan Cabaye's long-range opener for the hosts.
The Belgian marked his home debut with a brace in a 3-2 win at Goodison Park on Monday.
With time running out until the September 2 transfer deadline, Alan Pardew called on potential suitors to show their hand, saying: "I don't know if it's his last game for us until the deadline at 11 o'clock (2200GMT) on Monday.
Manchester City edged past Hull 2-0 while Newcastle beat Fulham 1-0.
Yohan Cabaye has crossed a line with his actions for many fans, and for that he will receive a frosty reception from a significant number of supporters when he pulls on a black and white shirt again.