基于多目标优化的Docker-微服务部署研究
Research of Multi-Objective Optimization Based Algorithm for Docker-Microservices Placement
DOI: 10.12677/AIRR.2017.62006, PDF, HTML, XML, 下载: 2,011  浏览: 6,277  国家自然科学基金支持
作者: 夏天宇, 江敏:福建省类脑计算技术及应用重点实验室(厦门大学);徐姜琴*:厦门大学外文学院
关键词: Docker微服务人工蜂群算法分布估计算法Docker Micro-Services Artificial Bee Colony Algorithm Estimation of Distribution Algorithm
摘要: Docker是一个开源的云计算应用容器引擎,由于可以使数量巨大的应用程序在已有的服务器上运行,因此受到广泛的关注。将Docker技术与微服务相结合可以显著改善性能,但是也带来了如何有效部署的问题。本文在分布式估计算法和人工蜂群算法的基础上,提出了一个称为MOMDA-ABC的算法。该算法可以优化部署微服务的Docker容器间的通信距离和主机数,从而使得云计算平台的性能有效提升。实验结果也证明该方法的有效性。
Abstract: Docker is an open-source cloud computing application container engine, because it can make a large number of applications run on the existing server, thus attracting a wide range of attention. Com-bining Docker technology with micro services can significantly improve performance, but it also brings about the problem of how to effectively deploy. In this paper, an algorithm called MOMDA-ABC is proposed based on distributed estimation algorithm and artificial bee colony algo-rithm. The algorithm can optimize the communication distance and host number between Docker containers that deploy micro services, which can improve the performance of cloud computing platform effectively. The experimental results also prove the effectiveness of the method.
文章引用:夏天宇, 徐姜琴, 江敏. 基于多目标优化的Docker-微服务部署研究[J]. 人工智能与机器人研究, 2017, 6(2): 41-55. https://doi.org/10.12677/AIRR.2017.62006

参考文献

[1] https://www.docker.com
[2] https://github.com/docker/docker
[3] https://eng.uber.com/building-tincup/
[4] Deb, K. (2014) Multi-Objective Optimization. In: Burke, E.K. and Kendall, G., Eds., Search Methodologies, Springer, Berlin, 403-449.
https://doi.org/10.1007/978-1-4614-6940-7_15
[5] Karaboga, D. (2005) An Idea Based on Honey Bee Swarm for Numerical Opti-mization. Computers Engineering Depart ment, Engineering Faculty, Erciyes University.
[6] Zhan, Z.-H., Liu, X.-F., et al. (2015) Cloud Computing Resource Scheduling and a Survey of Its Evolutionary Approaches. ACM Computing Surveys, 47, Article No. 63.
https://doi.org/10.1145/2788397
[7] Hu, H., Gu, J.H., Sun, G.F. and Zhao, T.H. (2010) A Scheduling Strategy on Load Bal-ancing of Virtual Machine Resources in Cloud Computing Environment. Proceedings of the 3rd International Symposium on Parallel Architectures, Algorithms and Programming, Dalian, 18-20 December 2010, 89-96.
[8] Lu, X. and Gu, Z.L. (2011) A Load-Adaptive Cloud Resource Scheduling Model Based on Ant Colony Algorithm. Proceedings of the IEEE International Conference on Cloud Computing and Intelligence Systems, Beijing, 15-17 September 2011, 296-300.
[9] Chen, S., Wu, J. and Lu, Z.H. (2012) A Cloud Computing Resource Scheduling Policy Based on Genetic Algorithm with Multiple Fitness. Proceedings of the IEEE 12th International Conference on Computer and Information Technology, Chengdu, 27-29 October 2012, 177-184.
[10] Feller, E., Rilling, L. and Morin, C. (2011) Energy-Aware Ant Colony Based Workload Placement in Clouds. Proceedings of the 12th IEEE/ACM Inter-national Conference on Grid Computing, Lyon, 21-23 September 2011, 26-33.
https://doi.org/10.1109/grid.2011.13
[11] Feller, E. and Morin, C. (2012) Autonomous and Energy-Aware Management of Large-Scale Cloud Infrastructures. Proceedings of the IEEE 26th International Parallel and Distributed Processing Symposium Work-shops & PhD Forum, Shanghai, 21-25 May 2012, 2542-2545.
[12] https://docs.docker.com/engine/swarm/
[13] https://github.com/docker/swarm
[14] Verma, A., Pedrosa, L., Korupolu, M., et al. (2015) Large-Scale Cluster Management at Google with Borg. Proceedings of the Tenth European Conference on Computer Systems, ACM, 18.
[15] https://kubernetes.io/
[16] Peinl, R., Holzschuher, F. and Pfitzer, F. (2016) Docker Cluster Man-agement for the Cloud—Survey Results and Own Solution. Journal of Grid Computing, 14, 265-282.
https://doi.org/10.1007/s10723-016-9366-y
[17] Amaral, M., Polo, J., Carrera, D., et al. (2015) Performance Evaluation of Micro-services Architectures Using Containers. IEEE 14th International Symposium on Network Computing and Applications (NCA), Cam-bridge, MA, 28-30 September 2015, 27-34.
https://doi.org/10.1109/nca.2015.49
[18] Stubbs, J., Moreira, W. and Dooley, R. (2015) Distributed Systems of Microservices Using Docker and Serfnode. 7th International Workshop on Science Gateways (IWSG), Budapest, 3-5 June 2015, 34-39.
https://doi.org/10.1109/iwsg.2015.16
[19] Guan, X., Wan, X., Choi, B.Y., et al. (2017) Application Oriented Dynamic Resource Allocation for Data Centers Using Docker Containers. IEEE Communications Letters, 21, 504-507.
[20] Johanson, A., Flögel, S., Dullo, C., et al. (2016) OceanTEA: Exploring Ocean-Derived Climate Data Using Microservices.
[21] Salza, P. and Ferrucci, F. (2016) An Approach for Parallel Genetic Algorithms in the Cloud Using Software Containers. arXivpreprint arXiv:1606.06961
[22] Salza, P., Ferrucci, F. and Sarro, F. (2016) Develop, Deploy and Execute Parallel Genetic Algorithms in the Cloud. Proceedings of the 2016 on Genetic and Evolutionary Computation Conference Companion, Denver, Colorado, 20-24 July 2016, 121-122.
[23] Larranaga, P. and Lozano, J.A. (2002) Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation. Kluwer Press, Boston.
https://doi.org/10.1007/978-1-4615-1539-5
[24] Muhlenbein, H. and Paass, G. (1996) From Recombination of Genes to the Estima-tion of Distributions I. Binary Parameters. In: Voigt, H.M., Ebeling, W., Rechenberg, I. and Schwefel, H.P., Eds., Parallel Problem Solving from Nature —PPSN IV. PPSN 1996. Lecture Notes in Computer Science, Vol. 1141, Springer, Berlin, Heidelberg, 178-187.
https://doi.org/10.1007/3-540-61723-X_982
[25] Muhlenbein, H. (1997) The Equation for Response to Selection and Its Use for Prediction. Evolutionary Computation, 5, 303-346.
https://doi.org/10.1162/evco.1997.5.3.303
[26] Jiang, M., Ding, Y., Goertzel, B., et al. (2014) Improving Machine Vision via Incorporating Expectation-Maximization into Deep Spatio-Temporal Learning. 2014 International Joint Conference on Neural Networks (IJCNN), Beijing, 6-11 July 2014, 1804-1811.
[27] Chao, F., Sun, Y., Wang, Z., et al. (2014) A Reduced Classifier Ensemble Approach to Human Gesture Classification for Robotic Chinese Handwriting. 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), Beijing, 6-11 July 2014, 1720-1727.
[28] Yao, G., Chao, F., Zeng, H., et al. (2014) Integrate Classifier Diversity Evaluation to Feature Selection Based Classifier Ensemble Reduction. 2014 14th UK Workshop on Computational Intelligence (UKCI), Bradford, 8-10 September 2014, 1-7.
[29] Lee, G., Tolia, N., Ranganathan, P. and Katz, R.H. (2011) Topology-Aware Resource Allocation for Data-Intensive Workloads. ACM SIGCOMM Computer Communication Review, 41, 120-124.
https://doi.org/10.1145/1925861.1925881
[30] Zhang, X., Jiang, M., Zhou, C., et al. (2012) Graded BDI Models for Agent Ar-chitectures Based on Łukasiewicz Logic and Propositional Dynamic Logic. International Conference on Web Information Systems and Mining, Chengdu, 26-28 October 2012, 439-450.
[31] Chao, F., Hu, L., Shi, M. and Jiang, M. (2011) Robotic 3D Reaching through a Development-Driven Double Neural Network Architecture. In: Wang, Y. and Li, T., Eds., Knowledge Engineering and Management. Advances in Intelligent and Soft Computing, Vol. 123, Springer, Berlin, Heidelberg, 179-184.
[32] Wu, Y., Jiang, M., Huang, Z., Chao, F. and Zhou, C. (2015) An NP-Complete Fragment of Fibring Logic. Annals of Mathematics and Artificial Intelligence, 75, 391-417.
https://doi.org/10.1007/s10472-015-9468-4
[33] Jiang, M., Yu, Y., Chao, F., et al. (2013) A Connectionist Model for 2-Dimensional Modal Logic. 2013 IEEE Symposium on Computational Intelligence for Human-Like Intelligence (CIHLI), Singapore, 16-19 April 2013, 54-59.
[34] Cai, Z., Goertzel, B., Zhou, C., et al. (2013) OpenPsi: A Novel Computational Affective Model and Its Application in Video Games. Engineering Applications of Artificial Intelligence, 26, 1-12.
[35] Chao, F., Wang, Z., Shang, C., et al. (2014) A Developmental Approach to Robotic Pointing via Human-Robot Interaction. Information Sciences, 283, 288-303.
[36] Jiang, M., Huang, W., Huang, Z. and Yen, G.G. (2017) Integration of Global and Local Metrics for Domain Adaptation Learning via Dimen-sionality Reduction. IEEE Transactions on Cybernetics, 47, 38-51.
https://doi.org/10.1109/TCYB.2015.2502483