船舶控制系统大数据存储节点数量较多,节点分布不均,影响负载均衡性,导致数据存储过程中存在安全性与容错性差等问题,为此研究云计算环境下舰船控制系统大数据有效存储方法。构建云计算环境下船舶控制系统大数据存储架构,利用分布式大数据存储层中的管理引擎采集舰船控制系统数据;通过MapReduce分布式并行模型将所采集的数据划分至分布式数据库内;针对分布式数据库内的数据,采用安全容错存储算法将待存储的数据均匀地划分至相应的硬件层中计算机服务器节点内,完成舰船控制系统数据有效存储。实验结果显示该方法能够实现不同存储节点负载均衡,且具有较好的大数据存储性能。
The ship control system has a large number of big data storage nodes and uneven distribution of nodes, which can affect load balancing and lead to issues such as poor security and fault tolerance in the data storage process. Therefore, an effective storage method for ship control system big data in cloud computing environment is studied. Build a big data storage architecture for ship control systems in a cloud computing environment, utilizing management engines in the distributed big data storage layer to collect big data from ship control systems in the application layer; Divide the collected ship control system big data into distributed databases through the MapReduce distributed parallel model; For the data in the distributed database, a secure fault-tolerant storage algorithm is used to evenly divide the ship control system big data to be stored into corresponding hardware layer computer server nodes, achieving effective storage of ship control system data. The experimental results show that this method can achieve load balancing among different storage nodes and has good big data storage performance.
2023,45(13): 170-173 收稿日期:2023-03-02
DOI:10.3404/j.issn.1672-7649.2023.13.035
分类号:TP391
基金项目:江苏航运职业技术学院度校级教育教改类研究项目(HYJY/2021B21)
作者简介:王颖(1986-),女,工程师,研究方向为计算机科学与技术
参考文献:
[1] 刘世缘, 李云春, 陈晨, 等. 面向大数据存储的主动与被动相结合的性能评测方法体系结构与实现[J]. 计算机工程与科学, 2022, 44(4): 584–593
Liu Shiyuan, Li Yunchun, Chen Chen, et al. Architecture combining active & passive performance evaluation methods and its implementation for big data storage[J]. Computer Engineering and Science, 2022, 44(4): 584–593
[2] 徐丽. 基于密度演化的分布式大数据云存储方法仿真[J]. 计算机仿真, 2021, 38(7): 424–428
Xu Li. Simulation of distributed large data cloud storage method based on density evolution[J]. Computer Simulation, 2021, 38(7): 424–428
[3] 王甜宇, 张柯欣, 孙艳秋, 等. 基于区块链的中医药大数据云存储共享方案研究[J]. 中华中医药学刊, 2022, 40(2): 132–135
WANG Tianyu, ZHANG Kexin, SUN Yanqiu, et al. Research on traditional chinese medicine big data cloud storage and sharing scheme based on blockchain[J]. Chinese Archives of Traditional Chinese Medicine, 2022, 40(2): 132–135
[4] 刘艳, 曹晓倩. 海量视频数据分布式存储性能优化方法研究[J]. 计算机应用研究, 2021, 38(6): 1734–1738
Liu Yan, Cao Xiaoqian. Research on performance optimization of distributed storage of massive video data[J]. Application Research of Computers, 2021, 38(6): 1734–1738
[5] 宋元, 周丹媛, 石文昌. 增强OpenStack Swift云存储系统安全功能的方法[J]. 吉林大学学报(工学版), 2021, 51(1): 314–322
SONG Yuan, ZHOU Dan-yuan, SHI Wen-chang. Method to enhance security function of OpenStack Swift cloud storage system[J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(1): 314–322
[6] 史骁, 宋永浩, 郑晓辉, 等. 面向强一致性的分布式对象存储的I/O并行性优化[J]. 高技术通讯, 2020, 30(2): 109–119
Shi Xiao, Song Yonghao, Zheng Xiaohui, et al. An approach to improve I/O parallelism for strong consistent distributed object storage[J]. Chinese High Technology Letters, 2020, 30(2): 109–119
[7] 曹布阳, 冯华森, 梁峻浩, 等. 利用Hilbert曲线与Cassandra技术实现时空大数据存储与索引[J]. 武汉大学学报(信息科学版), 2021, 46(5): 620–629
CAO Bu-yang, FENG Hua-sen, LIANG Jun-hao, et al. Hilbert Curve and Cassandra Based Indexing and Storing Approach for Large-Scale Spatiotemporal Data[J]. Geomatics and Information Science of Wuhan University, 2021, 46(5): 620–629