Brobbey had his shirt pulled by Ibrahima Konate in the Liverpool box on the stroke of half-time on Wednesday night but Kavanagh dismissed the penalty claims and instead blew for the interval.
But after watching the footage back, the referee held his hands up and admitted to Le Bris he'd made an error.
As Virgil van Dijk said this week, Brobbey has made life difficult for defenders since his summer arrival from Ajax, particularly in the last couple of months after establishing himself as Sunderland's first choice striker.
RECOMMENDED READING:
But Le Bris thinks Kavanagh's error on Wednesday night is another example of the physical striker getting a rough ride from match officials.
He's been repeatedly penalised by referees in instances when it appears Sunderland's striker is simply giving as good as he gets from opposition defenders.
Le Bris said: "I agree. The referee recognised his mistake at half-time, the penalty. It was a pen.
"His style of play is physical but he needs respect and a different point of view. It's not a usual style of play and I think at the minute he might be rewarded more often for sure."
Van Dijk, a teammate of Brobbey's for the Netherlands, told this week of how he's been hugely impressed by the striker's first season in the Premier League, and says there's much more to come.
Le Bris said: "Yes. And the two centre-backs on Wednesday were really good. Van Dijk and Konate were absolutely fantastic.
"I spoke a bit with Brian this morning. It shows they respected us. They are Liverpool and we faced a big, big challenge.
"He needs to keep going and with more opportunities and connections with his teammates, there will be the normal process of improvement.
"It was tough against Liverpool. He had three or four opportunities but the defenders were really excellent. He just has to keep going and keep the same mindset."