The January signing from Roma struck in the FA Cup defeat to Newcastle on Saturday.
While disappointed to be out of the Cup, Abraham is convinced about the quality and potential of the Villans.
Abraham said: "It was a difficult result to take. I’m proud of my team, we dug deep and we gave them a tough game.
“Of course, we know they have qualities to create chances and when the first goal went in, heads go down because being a man down, it’s always difficult.
“But, like I said, I’m proud of the boys and we just have to keep going. We always knew it was going to be a difficult game and losing a man is always going to be difficult, but we dug deep.
“And we just have to keep believing in ourselves – we’re still in the Europa League and we’re still in a good position in the Premier League.
“So, we have to just get together and keep going.”
Abraham's goal was his first for Villa since his time on-loan from Chelsea eight years ago.
"It means everything,” said the 28-year-old. “As a striker, you always want to score goals.
“I got unlucky with my first game, with the goal ruled out, but I’m always delighted to score and it’s good to be back.”