Jhon Arias scored the only goal of the game as Colombia edged past Ghana 1-0 to progress to a last 16 showdown with Switzerland at the 2026 World Cup.
Arias struck in the 14th minute at the Kansas City Stadium
Daniel Munoz played a ball to Luis Suarez, who sent it across the front of the goal, where Arias was waiting to flick it past the Ghana goalkeeper Lawrence Ati Zigi.
Ghana were unable to respond to the setback.
"I don't have the words to describe this moment," said Colombia midfielder Gustavo Puerta after the win.
"It's a dream come true. I think we've shown it game after game. This is a team that plays with its heart, that plays with its soul. We go after every ball as if it were the last."
Colombia had breezed through the group stage, conceding only a single goal in wins over Uzbekistan and Congo and a draw with Portugal.
Ghana reached the last 32 as one of the eight best third-placed teams with four points following a last-gasp win over Panama, a draw with England and a defeat to Croatia.
'The best team won'
"They controlled much better the game," said Ghana coach Carlos Queiroz.
"The passing, the movements, and doing that, they damaged our ability to recover the ball and try to go forward.
"We tried to create opportunities but the last pass, the last service, was not with the quality that was necessary. So, I think the best team won."
Colombia,face the Swiss on Tuesday in Vancouver in an attempt to reach the last eight for the first time since the 2014 World Cup in Brazil.