自适应隐私预算分配的差分隐私 Adam 算法

DIFFERENTIAL PRIVACY ADAM ALGORITHM FOR ADAPTIVE PRIVACY BUDGET ALLOCATION

  • 摘要: 针对用户个人敏感数据用来构建深度学习模型时,一些敏感数据会被网络所“记忆”,造成隐私的泄露。该文根据SGD算法中引入差分隐私所设计的DP-SGD算法的思想,在Adam算法中引入差分隐私,提出一种基于幂函数的自适应隐私预算分配算法来更合理地分配隐私预算,更好地平衡隐私性和模型准确性,以此设计了DP-Adam。实验结果表明,该文的DP-Adam算法比传统的DP-SGD 算法在相同隐私预算下,具有更好的准确性,低隐私预算情况下高出约5%,中高隐私预算情况下高出约2%;并且将幂函数分配算法与指数函数分配算法做比较,前者具有更好的适用性。

     

    Abstract: When users’personal sensitive data are used to build deep learning models, some sensitive data will be " remembered " by the network, resulting in privacy leakage. This paper proposes DP-Adam by introducing differential privacy into the Adam algorithm, drawing inspiration from the DP-SGD algorithm which incorporates differential privacy into SGD. The proposed approach develops a power-function-based adaptive privacy budget allocation mechanism to achieve more rational privacy budget distribution, thereby better balancing privacy preservation and model accuracy. The experimental results show that the DP-Adam algorithm in this paper has better privacy budget than the traditional DP- SGD algorithm. The experimental results show that this paper’s DP-Adam algorithm has better accuracy than the traditional DP-SGD algorithm under the same privacy budget, about 5% higher in the case of low privacy budget and about 2% higher in the case of medium-high privacy budget. Comparative analysis between the power-function-based allocation algorithm and the exponential-function-based allocation algorithm demonstrates that the former exhibits superior adaptability.

     

/

返回文章
返回