Eddie Howe has made four changes to the team that kicked off Wednesday's Premier League win over Manchester United, with Woltemade, Osula, Sven Botman and Joe Willock all being promoted to the starting side.
Botman partners Malick Thiaw at centre-half, with Dan Burn dropping down to the substitutes' bench.
Willock and Woltemade are expected to play alongside Sandro Tonali at the heart of the Magpies midfield, with Joelinton on the bench and Jacob Ramsey unavailable following his dismissal in the Manchester United game.
Osula gets the nod to start in attack, having come off the bench to score a dramatic last-minute winner on Wednesday, with Anthony Gordon named amongst the replacements.
Newcastle's bench also features Tino Livramento, who is back in a match-day squad for the first time since suffering a knee injury in the FA Cup win over Bournemouth at the start of January.
NEWCASTLE (4-3-3): Ramsdale; Trippier, Thiaw, Botman, Hall; Willock, Tonali, Woltemade; Elanga, Osula, Barnes.
Subs: Pope, Joelinton, Wissa, Gordon, Livramento, J Murphy, Burn, A Murphy, Neave.