Council home tenants must pay a rent hike of 1.5 per cent annually over the next three years.
South Ayrshire Council says the move will ensure investment in properties and equates to £1.50 per week for most residents.
It vows to spruce up 3,050 homes internally over the next five years and pointed out 722 properties will have received new windows by the end of March this year.
But Conservative councillors called for a freeze on the rent for a year during a full council meeting this week held in private.
Conservative leader Martin Dowey pointed out people on furlough would be impacted by the rise.
The Ayr West politician said: “Ten Conservatives voted against the council’s rent increase. During a global pandemic when our tenants are really struggling financially this is not the time for a rent increase.
“We asked for a one-year freeze on any increase but were defeated. I am bitterly disappointed in this decision and the further strain it will put on our hard-working tenants.”
Councillor Philip Saxton, responsible for housing and community, said not rolling out a rent increase would cost about £92 million over the the course of three years.
The Labour councillor said it would put housing investment plans in jeopardy and advised help was out there for anyone struggling to pay.
Councillor Saxton said: “Many councils are having to make difficult decisions on rent increases at the moment.
“Unfortunately, not putting up rent was not an option, so in line with tenant feedback, we have gone for the smallest increase possible which still allows us to improve our housing stock and deliver on the commitments previously agreed with our tenants.”
People living in North and South Carrick villages have received new windows in their homes. Work is underway to finish window installations in Annbank, Tarbolton and Craigie Village.
The council said external wall insulation, reroofing and render upgrade programmes are taking place across South Ayrshire. Newly-built affordable housing is also on the way.
The rent increase will start this year and consultation took place with tenants.
The way the council charges for rental on sheltered housing will not change, but they will also be subject to a 1.5 per cent rise.
Rent on most new-build properties is also to stay the same for a further three years.