A Framework of Efficient Storage Management for Distributed Storage System

Abstract

As storage systems grow larger and more complex, the traditional block-based file systems cannot satisfy the large workload. More recent distributed file systems have adopted architectures based on object-based storage. This paper presents a framework of efficient storage management for distributed storage system. In object storage side which manage disk block allocation internally by object-based storage devices (OSDs), low-level storage tasks and data distribution must be managed, and in metadata server side, we will manage how to scale the metadata. Due to the high space efficiency and fast query response, we will utilize bloom-filter based approach to manage metadata and add semantic-based scheme to narrow the managed workload. Then we will optimize the data distribution in OSDs using chord mechanism.