Twelve more prisoners have been wrongly freed from jail in recent weeks, says Justice Secretary David Lammy.
Two are still on the run.
Mr Lammy said the two individuals were not violent or sex offenders.
The latest blunders take the number of inmates released by mistake to more than 100 since April.
The Cabinet minister did not give details of the two individuals still at large, stressing he did not want to thwart police hunts to catch them.
But asked about mistaken releases from prison, Mr Lammy told BBC Breakfast: “There has been a spike, it’s on a downward trajectory.
“There have been 12 since I made that statement (November 11).
“At the moment two are currently at large.”
He added: “I made clear to Parliament that the trajectory began to increase in the last four years of the last Government because of their new release scheme, the complexity of that system.”
But the Labour Government has been accused of causing more inmates to be wrongly freed with its early release scheme.
Shadow justice secretary Robert Jenrick said: "Calamity Lammy is utterly clueless.
"The public are consistently being put at risk because of his shambolic management. When will this fiasco end?"
Liberal Democrat justice spokesperson Jess Brown-Fuller MP added: “Just when you couldn’t think things could get any worse for the Ministry of Justice, somehow again it has.
“It’s utterly unacceptable that public safety has been put at risk yet again.”
When Mr Lammy made his statement to Parliament on November 11, 91 prisoners had been freed by error between April and October this year.
The extra 12 takes the figure to more than 100.
The Justice Secretary said on Tuesday that there were one or two cases happening a week.
He stressed that jails still relying on paper-based system was a cause.
The Government vowed to put in tougher checks to stop the blunders but the mistakes still continue.
Ministers have also agreed to an AI bot being used to try to stop the releases by error.
Asked about Wandsworth jail, from where some inmates have recently been wrongly released, Mr Lammy told LBC Radio: “There are issues at Wandsworth.”
But he stressed there were problems at other prisons including Pentonville and Belmarsh.
He emphasised it was a “mountain to climb” to address the issues blighting the prison system.
The scandal of wrongful releases became public after the case of Epping sex offender Hadush Kebatu .
The Ethiopian national was wrongly freed from HMP Chelmsford instead of being sent to an immigration detention centre.
The former asylum seeker, who had been living at the Bell Hotel in Epping, Essex, when he sexually assaulted a 14-year-old girl and a woman, travelled to London and was later arrested in Finsbury Park after a two-day manhunt.
Immigration officials paid him £500 so he did not disrupt a deportation flight back to Ethiopia.
Mr Lammy said he would be meeting the family of Kebatu’s victim.
”They are meeting with the Prisons Minister. I intend to be there at that meeting,” he said.
“I hope it's been scheduled because, of course, any victim of crime who then finds out that the prisoner has been wrongly released, should not be put through that trauma.
“And of course, I apologise, and I am sorry.”
Shortly after the Kebatu case, two more prisoners were on the run after being accidentally released including an Algerian sex offender who had been at HMP Wandsworth.
Brahim Kaddour-Cherif, 24, was later arrested near Capital City College on Blackstock Road in Islington, north London, the Metropolitan Police said.
William Smith, 35, who was jailed for 45 months for fraud, was released from the Category B prison in south west London on the same day he was jailed.
He later handed himself back in to HMP Wandsworth.
