Divisions in the CFMEU have deepened with the national and manufacturing branches shifting out of the office they share with the construction group in Melbourne.
There has been tension within the union between those who continue to support controversial construction division secretary John Setka and those who want him gone.
Earlier this year, Mr Setka pleaded guilty to harassing his wife on the phone and breaching a court order.
Labor leader Anthony Albanese moved to expel the firebrand union leader after it was alleged he denigrated anti-violence campaigner Rosie Batty, a claim Mr Setka rejects.
ACTU secretary Sally McManus also urged Mr Setka to stand aside.
The manufacturing division — the "F" in CFMEU — represents forestry, furnishing, building products, pulp and paper, textile, clothing and footwear manufacturing workers.
Labor powerbroker Michael O'Connor is the national secretary of the union as well as secretary of the manufacturing division.
He has faced criticism for staying silent about the dispute.
Sources told the ABC the decision to move out of the Elizabeth Street headquarters was linked to the ongoing issues in the CFMEU.
A senior source from the construction group said the division was owed more than $500,000 from the manufacturing branch.
Inside the union there have been claims of the construction division trying to poach members from rival divisions.
"It's the C eating the F," one senior figure said.
The ABC has sought comment from Mr Setka and Mr O'Connor. The union denied to comment.
