一种基于置信传播的算法求解随机约束满足问题
A Belief Propagation Based Algorithm for Solving Stochastic Constraint Satisfaction Problem
摘要: 为了求解具有增长域的随机约束满足问题(CSP),提出一种基于置信传播的算法即NBP* (new-selected belief propagation*, NBP*)。在置信传播算法中,当BP方程不收敛时,算法就会终止。然而算法在经过多次迭代之后,虽然约束发送给变量的信息没有达到收敛条件,但是仍有部分信息是准确的,所以当算法的BP方程不收敛时,提出利用最后一次迭代得到的约束发送给变量的信息来计算变量的边际概率,当赋值不满足约束时,根据边际概率确定的变量顺序挑选下一个变量进行赋值,得到NBP*算法。数值实验表明:这种算法可以在可满足性相变区域找到解,并且有效提高了置信传播算法的求解效率。
Abstract: In order to solve the stochastic constraint satisfaction problem (CSP) with a growing domain, a belief propagation based algorithm called NBP* (new selected belief propagation*, NBP*) is proposed. In the belief propagation algorithm, when the BP equation does not converge, the algorithm will terminate. However, after multiple iterations, although the information sent by the constraint to the variable did not meet the convergence condition, some information was still accurate. Therefore, when the BP equation of the algorithm does not converge, it is proposed to use the information sent by the constraint to the variable from the last iteration to calculate the marginal probability of the variable. When the assignment does not meet the constraint, the next variable is selected according to the variable order determined by the marginal probability for assignment, resulting in the NBP* algorithm. Numerical experiments have shown that this algorithm can find solutions in the satisfiable phase transition region and effectively improve the efficiency of the confidence propagation algorithm.
文章引用:刘梦圆. 一种基于置信传播的算法求解随机约束满足问题[J]. 理论数学, 2024, 14(6): 54-64. https://doi.org/10.12677/pm.2024.146227

参考文献

[1] Gent, I.P., Macintyre, E., Prosser, P., et al. (2001) Random Constraint Satisfaction: Flaws and Structure. Constraints, 6, 345-372. [Google Scholar] [CrossRef
[2] Prosser, P. (1996) An Empirical Study of Phase Transitions in Binary Constraint Satisfaction Problems. Artificial Intelligence, 81, 81-109. [Google Scholar] [CrossRef
[3] Smith, B.M. and Dyer, M.E. (1996) Locating the Phase Transition in Binary Constraint Satisfaction Problems. Artificial Intelligence, 81, 155-181. [Google Scholar] [CrossRef
[4] Achlioptas, D., Molloy, M.S.O., Lirousis, L.M., et al. (2001) Random Constraint Satisfaction: A More Accurate Picture. Constraints, 6, 329-344. [Google Scholar] [CrossRef
[5] Xu, K. and Li, W. (2000) Exact Phase Transitions in Random Constraint Satisfaction Problems. Journal of Artificial Intelligence Research, 12, 93-103. [Google Scholar] [CrossRef
[6] Frieze, A.M. and Molloy, M. (2006) The Satisfiability Threshold for Randomly Generated Binary Constraint Satisfaction Problems. Random Structure and Algorithms, 28, 323-339. [Google Scholar] [CrossRef
[7] Smith, B.M. (2001) Constructing an Asymptotic Phase Transition in Random Binary Constraint Satisfaction Problems. Theoretical Computer Science, 265, 265-283. [Google Scholar] [CrossRef
[8] Molloy, M. (2003) Models for Random Constraint Satisfaction Problems. SIAM Journal of Computing, 32, 935-949. [Google Scholar] [CrossRef
[9] Xu, K. and Li, W. (2006) Many Hard Examples in Exact Phase Transitions. Theoretical Computer Science, 355, 291-302. [Google Scholar] [CrossRef
[10] Sulc, P. and Zdeborová, L. (2010) Belief Propagation for Graph Portioning. Journal of Physics A: Mathematical and Theoretical, 43, Article 285003. [Google Scholar] [CrossRef
[11] Xu, K., Boussemart, F., Hemery, F., et al. (2007) Random Constraint Satisfaction: Easy Generation of Hard (Satisfiable) Instances. Artificial Intelligence, 171, 514-534. [Google Scholar] [CrossRef
[12] Zhao, C.Y., Zhou, H.J., Zheng, Z.M., et al. (2011) A Message Passing Approach to Random Constraint Satisfaction Problems with Growing Domains. Journal of Statistical Mechanics: Theory and Experiment, 2011, P02019. [Google Scholar] [CrossRef
[13] 赵春艳, 郑志明. 一种基于变量熵求解约束满足问题的置信传播算法[J]. 中国科学: 信息科学, 2012, 42(9): 1170-1180.
[14] 任雪亮. 改进的置信传播算法在求解最大约束满足问题的应用[D]: [硕士学位论文]. 长春: 东北师范大学, 2015.
[15] 吴拨荣, 赵春艳, 原志强. 置信传播和模拟退火相结合求解约束满足问题[J]. 计算机应用研究, 2019, 36(5): 1297-1301.
[16] Zhao, C.Y. and Fu, Y.R. (2021) Belief Propagation Guided Decimation Algorithms for Random Constraint Satisfaction Problems with Growing Domains. Journal of Statistical Mechanics: Theory and Experiment, 2021, Article 033408. [Google Scholar] [CrossRef
[17] Zhao, C.Y., Fu, Y.R. and Zhao, J.H. (2022) A Residual-Based Message Passing Algorithm for Constraint Satisfaction Problems. Communications in Theoretical Physics, 74, Article 035601. [Google Scholar] [CrossRef