Saints, on nine points, are within reach of surpassing Derby's record-low points tally of 11 but have only won once under Ivan Juric.
They are on a run of nine consecutive defeats at St Mary's, most recently losing 2-1 to Wolves, and host in-form Crystal Palace this evening.
Ramsdale admitted the players have spoken about the importance of avoiding an unwanted record and revealed they are aiming for even more points.
"We want to get back into the rhythm now and try and finish as respectfully as possible, show that we can fight and get as many points as we can," Ramsdale told the Daily Echo.
Aaron Ramsdale has conceded 50 goals in 21 games for Southampton.Aaron Ramsdale has conceded 50 goals in 21 games for Southampton. (Image: Andrew Matthews/PA) "We might win the next three, we might win the last three, we might take until the last game of the season, but I think we're going to fight for everything.
"It's the last stretch of the season and, as I said, it's about finishing respectfully for the people who pay top money and have followed us all season."
Ramsdale added: "I think, first and foremost, our first goal is to get three points, and that does take us over that record.
"I think it's about winning three points rather than thinking about the record. We have won nine points all year. It's ridiculously low and too low for us.
"We knew it was going to be tough this season. It has been mentioned because I'm not too sure everybody in the changing room knew about it.
"We mentioned that it won't leave you alone, it won't go away after you finish or you move on. It is important that we try and beat it, but we're talking about three points.
Aaron Ramsdale was left out of both matchday squads with England last month.Aaron Ramsdale was left out of both matchday squads with England last month. (Image: Martin Rickett/PA) "Then we can look to get the next three points or a point. We are trying to finish as respectfully as possible. Can we get to 18 or 19 points? Can we get to 20 points?
"First and foremost, it's about three points, which ultimately does take us over the record as well, which will be a huge relief when we manage to do that."
Palace have only lost twice in 2025 and booked their place in the FA Cup semi-final following a 3-0 win over Fulham on Saturday.
Ramsdale is well aware of the danger Palace have going forward and acknowledged Saints need to be at their best to win points.
"Hopefully, it's going to be a good night for us. With the work we've been able to put together, hopefully, we can put that into fruition on the pitch," he said.
"Ultimately, with Palace, they've got Eze, Mateta, Sarr, Nketiah and other players who can change the game in an instant.
"They're going to be well-drilled, and we've just got to hopefully combat that and be solid ourselves and get a bit of magic to win the game or at least a couple of points."