After such a poor first half in which hardly a chance was created by either side, the game burst into life when Valentin Stocker put the visitors in front early in the second half.
Thomas Tuchel's side though responded well and after missing three big chances, including missing a penalty, Pierre-Emerick Aubameyang scored the equaliser ten minutes from the end.
Throughout the game, there were many fouls and before the end of the game both sides had a man sent off. Firstly, Emre Mor was sent off for reacting badly to a challenge on him before Stocker was sent off for a bad lunge before the end.
The result means that both sides are likely to lose more ground on Bayern Munich, who play on Saturday afternoon.
Both teams struggle to create anything of note in the first half
The first half was a real tactical battle as both sides cancelled each other out well as there weren't many goalscoring opportunities for either side.
The only real chance of note went the way of the hosts very early on when a great cross into the box from Christian Pulisic found Mor unmarked at the back post.
The young winger though was unable to control his first time shot well enough and hit it over the bar when he should have done so much better.
At the other end, the visitors had opportunities to counter but their final ball was very poor leading to many attacks fizzling out.
The flow of the game was also halted throughout as both sets of players committed many niggly fouls to stop each other from getting control of the game.
It meant that at half-time, the scoreline was goalless with the home side being very frustrated by the way the visitors were playing.
Stocker opened the scoring early in the second half
The second half, however, was a much better game on the eye as the visitors went in front within six minutes of the restart.
The goal was created by a moment of genius from Vedad Ibisevic, who held off two defenders and played a beautiful back heel pass through to Stocker and the midfielder made no mistake with his weaker right foot as he calmly put the ball in the net past Roman Bürki.
The goal opened the game up as the hosts finally started to put good attacks together for the first time in the match.
Firstly, Marcel Schmelzer forced Rune Jarstein into making a good diving save to keep his side in front.
Aubameyang scores equaliser but should have had a hattrick
Aubameyang then had two chances in two minutes that he should have scored from. The first chance came from a good cross from Mor which he met but his shot was straight at Jarstein.
The second chance was one that you expect such a good striker to score which he failed to do. Ousmane Dembélé, on as a second-half substitute, played a brilliant through pass to the striker, who ran towards goal and decided to chip Jarstein, who tipped the ball over his head with the ball trickling onto the post and somehow Aubameyang failed to put the ball in the net after that.
The hosts kept pushing for an equaliser and they were awarded a penalty when Shinji Kagawa hit a shot towards goal which hit Genki Haraguchi on the hand and referee Patrick Ittrich pointed to the spot.
Aubameyang stepped up to take it but saw his poor shot saved by Jarstein, who was making himself a hero for the visitors on the night.
The striker though after missing three guilt-edged chances, finally put one in the net to get a crucial equaliser for his side. The goal was created by the impressive Dembélé, who played a brilliant cross across the goal which the striker put into an empty net.
Both sides finish with 10 men
The action didn't stop there as after so many fouls in the game there was finally a sending off. Mor reacted to being fouled by getting up and pushing Sebastian Langkamp in the chest and was shown a straight red for that reaction.
Not to be outdone, the visitors goalscorer Stocker was sent off before the end for a very poor challenge on Matthias Ginter from behind.
The game ended then not long after that as the game finished in a draw but in the second half it could have been so much more for the hosts, who missed loads of chances to win the game.