Trollip, speaking in the National Assembly after the president's budget speech, said Zuma's administration was being haunted by the ghosts of his predecessor, former President Thabo Mbeki.
"President Zuma you must reign in the ANC's tripartite alliance partners' (the SA Communist party and the Congress of SA Trade Unions) insatiable appetite for power," said Trollip, who was jeered and heckled throughout his speech.
"No one voted on 22 April to have a one-party state. It is imperative that you distance yourself from the failures of your predecessor."
Trollip said the presidency was being held hostage by ANC.
"The secretary-general of the ANC (Gwede Mantashe) is not the president," Trollip said.
"The ANC is hell bent on diminishing civil society."
Zuma's plans went far beyond his budget and the government was expanding too rapidly, he said, which would mean a growth in bureaucracy.
Trollip had harsh words for Co-operative Governance Minister Sicelo Shiceka who said earlier this week that he would in the future like to do away with South Africa's provinces.
"We will not allow the ANC to stop us governing the province we won in a free and fair election," Trollip said.
Sapa
Judge Hlophe bashes Latin; Malema hates Mickey Mouse; and Lekota hasn't punched anyone...
Should our judicial system be 'Africanised'? Ebrahim Moolla takes on Rebekah Kendal...
Do you need a laugh? Then check out our offbeat stories from around the world...