Distributed storage method based on information dispersal algorithm
- Resource Type
- Conference
- Authors
- Ling, Jie; Jiang, Xiangyang
- Source
- 2013 2nd International Symposium on Instrumentation and Measurement, Sensor Network and Automation (IMSNA) Instrumentation and Measurement, Sensor Network and Automation (IMSNA), 2013 2nd International Symposium on. :624-626 Dec, 2013
- Subject
- Communication, Networking and Broadcast Technologies
Computing and Processing
Robotics and Control Systems
Availability
Load management
Aerospace electronics
Instrumentation and measurement
Automation
Algorithm design and analysis
Computers
information dispersal algorithm
HDFS
distributed storage
load balancing ability
- Language
In order to improve the storage efficiency of Hadoop Distributed File System (HDFS) and its load balancing ability, this paper presented a distributed storage method based on information dispersal algorithm (IDA). The method used IDA to encode files to blocks, and stored the blocks in the cluster by the improved data placement strategy. The results and analysis of the experiments show that the method improves the storage efficiency and load balancing ability.