Good Morning Britain viewers voiced their anger after a university professor branded the Queen the "face of white supremacy".
Students at one of the University of Oxford's colleges have reportedly agreed to remove the painting as "patriotism and colonialism are not really separable".
The alleged decision has sparked fury online, with the president of Magdalen College distancing the institution itself from the students involved.
Appearing on Good Morning Britain to debate whether students were correct to take down the portrait, Professor Kehinde Andrews, who teaches Black Studies at Birmingham University, was joined by Oxford student Calvin Robinson.
Professor Andrews argued that the students were right to take down the portrait and said: "If we are honest The Queen is the number one symbol of white supremacy in the world.
"That is what she represents. What else could you say?"
Host Richard Madeley was left gobsmacked by his remarks and accused him of speaking rubbish.
"But the Commonwealth aren't a collection of enslaved countries," Richard remarked. "The countries that belong to the Commonwealth do so purely voluntarily. It's not an empire. You can't call it an empire, because it's not!"
The professor conceded it "may have changed slightly", but added: "Countries like Jamaica are part of the Commonwealth because their economies are still heavily dependent on colonial ideas and practices.
"This is actually why they vote to stay in the Commonwealth. The idea this suddenly changed and everything is great is complete nonsense. Actually, most parts of the former colonies are still in a very deeply colonial relationship, economically, with the UK and the Queen represents that. So the students are 100% right."
But viewers were largely angered by the remarks and took to Twitter to comment.
One tweeted: "#GMB @GMB the queen is a white supremacist....SWITCHED OFF. Sort out your programme!"
While another commented: "#GMB who is this muppet? I am no fan of the monarchy, but the Queen being a white supremacist. What a moron."
A third fumed: "Who's this racist on GMB calling the Queen a white supremacist? Why do they have racists on?! #GMB."
But others agreed with the professor, with one commenting: "I support @kehinde_andrews. At last somebody who says what I have thought for years (at least since the 80's). I wish he could have been my lecturer."
*Good Morning Britain airs weekdays at 6am on ITV
