Ramsdale featured in last night's 2-1 quarterfinal win against Fulham on Wednesday night.
He said at the final whistle, "We're the holders of the cup from last year, and we sense that we can go on again and win it for the supporters.
"Obviously, I wasn't here last year, but I know everything about it! I have been made aware of how much joy it brought the players and the supporters. The jubilation was there for all to see, and we want to win it again."
Fellow summer arrival Yoane Wissa scored a first goal for Newcastle on the night.
And the striker said: "I've been here and knew it was special. Now playing with the Newcastle shirt, it is different. Very happy today.
"Winning a Cup is special. They did it last year when I wasn't there, so now I want to do it."