Unai Emery’s team have made a disappointing start to the campaign, taking just one point from their first three Premier League matches.
They are also the only team in England’s top six divisions yet to score a goal and sit 19th in the early season table.
But Digne is confident a team which has finished in the top-seven in each of the last three seasons will soon begin climbing the standings.
He said: “It’s just the beginning of the season and we have to stay calm and positive.
“We have to work hard because the work always pays off and I am sure we have the team.
“The performances will come and I am not worried about that.
“We have to stay calm and trust in our process and in our work because we are working really hard here.
“We have a really good team and it’s just a question of time.”
Digne is one of several Villa players currently away on international duty.
The 32-year-old, capped 52 times by France, was recalled to the squad after a two-year absence 12 months ago thanks to his impressive club form.
Playing in next summer’s World Cup is among his main goals this season but he knows it is performances for Villa which matter most.
Digne, who signed a new three-year contract in the summer, said: “It’s always a pleasure to be called up by the national team.
“It’s been hard work for me to be with the national team because it’s a goal to reach it, but the main thing is the club. If you don’t perform in your club, you don’t get called up.”