Developing a sequential data migration method for document-based database and key value database

Abstract

Data migration between databases is commonly occurred due to reasons such as migration of legacy system to new system, sharing and updating of data between systems and et cetera.  In the cases of migration between NoSQL database such as MongoDB and Redis, the migration of data may not as straight forward as directly moving the data to the designated database.  One of the reasons is due to the different storage paradigm of the databases.  MongoDB stores data into Json document where Redis manages records by applying key-mapping.   In addition, the flexibility of MongoDB’s storage paradigm allows records within the same collection to be stored in different structure.  Furthermore, the flexibility of storage paradigm will lead to the complexity of record structure such as nested documents.  Therefore, this affects the storage structure on the targeted database. The research is to examine the storage schema of Redis in handling the data migrated from MongoDB.  From the result of research experiment, the predetermined structure is able to represent the targeted record (document) schema from MongoDB