
A strike from range from Ryan Gravenberch in the first half put the Reds in pole position, with matters getting worse for the home side when Anthony Gordon received a red card for a dangerous challenge on Virgil Van Dijk.
Hugo Ekitike then doubled Liverpool's lead in the opening minute of the second period - his second goal of the Premier League season.
However, Newcastle halved the deficit courtesy of Bruno Guimarães, before William Osula found an equaliser with four minutes of normal time to play.
In dramatic fashion, Rio Ngumoha ensured three points headed back to Merseyside - netting in the 100th minute on his Premier League debut.
After a five-goal thriller on Tyneside, what have we learnt about this Liverpool team?
The rise of Rio
At just 16 years and 361 days old, Ngumoha became the youngest goalscorer in Liverpool's 133-year history, and the fourth youngest in Premier League history with his winner at St James' Park.
A brilliantly worked piece of play was rounded off with an audacious dummy by Dominik Szoboszlai, leaving the ball in the stride of the youngster who curled home with conviction.
It was a dream debut for Ngumoha, who has rightfully taken some spotlight in recent weeks. The teenager was the highlight of the Merseyside outfit's pre-season, which has caused Liverpool fans to speculate just how big of a role Ngumoha would play this season.
In spectacular fashion, the 16-year-old displayed how important he could be for the Reds last night, immediately settling into a hostile St James' Park atmosphere.
The winger oozed confidence as soon as he came on the pitch, with his first touches consisting of driving down the left flank and testing Tino Livramento one-on-one.
When it mattered most, Ngumoha showed nerves of steel, grabbing the winner in a game where most would agree Liverpool did not deserve three points.
Ekitike's excellence
Alexander Isak has taken centre stage for the entirety of the transfer window, amid his potential move to Liverpool, meaning Ekitike's super start for the Reds has perhaps gone under the radar.
It is now three goals in three games for the striker, who came up with the goods yet again last night - coolly finishing into the bottom left corner with his only real chance of the game.
Although Liverpool fans admired Darwin Nunez during his time at the club, Ekitike already looks already looks a more ruthless package at the top end of the pitch.
The Frenchman has slotted in seamlessly in the number nine position, combining and linking up play expertly, along with taking his chances in key moments.
While Liverpool still appear thin up front, the striker's red-hot form at the start of this campaign is bound to have given Reds' fans confidence in what the 23-year-old can bring to the table.
Managing the game
Whilst last night's match ended in delight for the Liverpool, the Reds must assume greater control of matches if they are to compete in a title race this season.
Arne Slot's men have shaped up differently this campaign, with the signings of Florian Wirtz and attacking full backs Jeremie Frimpong and Milos Kerkez leaving the Reds very exposed on the counter attack in several moments already.
Even though Frimpong was unavailable last night, this pattern repeated itself. It looks as though it will take time for Liverpool to find a balance between attacking fluidity and defensive stability.
The Merseyside outfit have let a two-goal advantage slip twice already this campaign, a worrying habit which may not be sustainable as the season progresses.
An Antoine Semenyo brace in the league opener was almost Liverpool's undoing against Bournemouth, and the reigning Premier League champions were very close to being punished in similar circumstances last night.
Despite the Magpies being a man down, with hopes of a comeback rapidly diminishing due to Hugo Ekikike's goal, United were on the front foot throughout the second period and looked the better side by a good margin.
Most of the play was in Liverpool's half as the Reds struggled to manage the game and tire Newcastle's 10 men.
This allowed the Tyneside outfit to gain a foothold back on the game, courtesy of two goals Liverpool will feel were very avoidable.
Defensive woes
Six points from two games looks to be a dream start on paper for Liverpool, however conceding four goals in that period will no doubt be a concern for manager Slot.
Two of those goals were shipped last night. The first of these came via a Guimarães header. New signing Kerkez struggled to match the Newcastle captain physically, allowing the Brazilian to leap high and head home.
Liverpool would have felt Newcastle's second was equally frustrating to concede - a long free kick from Nick Pope was not dealt with, giving Osula the space to nip in front of Alisson Becker and equalise.
Whilst Kerkez has no doubt struggled to settle into the full back position in the opening fixtures, Ibrahima Konate has been the biggest worry in the backline.
A stalwart in the defence alongside Van Dijk last season, Konate has started this campaign poorly.
The Frenchman was simply not at the races at St James' Park, with the 26-year-old losing individual duels and giving the ball away throughout.
In the summer transfer window, Liverpool have been heavily linked with Crystal Palace captain Marc Guehi, who has one year remaining on his current deal at the South London side.
With Konate's current form, many fans may wish even more for the Reds to secure the signing of Guehi.
Similar to the Bournemouth game, Liverpool yet again relied on the heroics of captain Van Dijk to maintain stability in the backline, a pattern which must change soon before points are dropped.

