基于大数据的雷达数据快速存储与分析研究

    Rapid Storage and Analysis of Radar Data Based on Big Data

    • 摘要: 针对从大量雷达数据中发现频繁序列的问题,构建了一个基于Hadoop和Spark的雷达数据存储和分析系统。通过Hadoop和Spark的结合,可实现大量雷达数据的快速存储和分析。在所提系统中,Hadoop使用分布式方式提供稳定高效的数据存储,Spark提供高效的内存计算,建立了一个三节点的Hadoop-Spark集群执行分布式数据挖掘算法。此外,为提高雷达数据的分析精度,对雷达数据进行预处理且对挖掘结果进行后处理。结果表明:文中方法可高效准确地存储与分析海量的雷达数据。

       

      Abstract: A radar data storage and analysis system based on Hadoop and Spark is constructed for the problem of discovering frequent sequences from large amounts of radar data. The combination of Hadoop and Spark enables the fast storage and analysis of large amounts of radar data. In the proposed system, Hadoop uses a distributed approach to provide stable and efficient data storage, and Spark provides efficient in-memory computing. A three-node Hadoop-Spark cluster is established to execute distributed data mining algorithms. In addition, to improve the accuracy of radar data analysis, the radar data is pre-processed and the mining results are post-processed. The experimental results show that the proposed method can store and analyse large amounts of radar data efficiently and accurately.

       

    /

    返回文章
    返回