Phone-tapping should be used to track criminals and not to settle political scores, Sports Minister Fikile Mbalula said on Monday.
Concerns were raised about controversial crime intelligence head Richard Mdluli's authority to intercept phone conversations.
His control over the country's VIP security unit, which protects Cabinet ministers, was also a cause for concern.
Speaking on Talk Radio 702, the former deputy minister of police was reluctant to confirm whether his phone had been tapped.
"I told Mdluli, when I was in the police, that somebody was listening to my phone [conversations]. He came back to me with a report and said nobody was listening to me.
"Later on, I got a report that I was part of the 'Estcourt meeting', a report compiled by Mdluli."
ANCYL Deputy President Ronald Lamola voiced similar concerns.
"We are now even afraid to phone our wives or to talk to sources through telephones," he said.
The minister strongly warned against intercepting phone calls for political purposes rather than criminal investigations.