SAT-Hadoop-Processor: A Distributed Remote Sensing Big Data Processing Software for Earth Observation Applications

SAT-Hadoop-Processor: A Distributed Remote Sensing Big Data Processing Software for Earth Observation Applications

Blog Article

Nowadays, several environmental applications take advantage of remote sensing techniques.A considerable volume of this remote sensing data occurs in near real-time.Such data are diverse and are provided with high velocity and variety, their pre-processing requires large computing capacities, and a fast execution time is critical.This paper 14765-prb-a01 proposes a new distributed software for remote sensing data pre-processing and ingestion using cloud computing technology, specifically OpenStack.

The developed software discarded 86% of the unneeded daily files and training day horse supplement removed around 20% of the erroneous and inaccurate datasets.The parallel processing optimized the total execution time by 90%.Finally, the software efficiently processed and integrated data into the Hadoop storage system, notably the HDFS, HBase, and Hive.