Design and Optimisation of Distributed Data Processing Platform Driven by Digital Economy

DOI

10.2991/978-94-6463-724-3_18How to use a DOI?

Keywords

Distributed data processing; Microservice architecture; Performance optimisation; Digital economy; load balancing

Abstract

This research designs a microservices-based distributed data processing platform with a fourtier architecture for flexible scaling. It incorporates unified hashing for data slicing and dynamic load balancing for optimized operation. To address performance bottlenecks, the platform uses multi-level caching, separate read-write processing, and message queue sharding. Test results confirm the platform outperforms similar products in response speed, processing capacity, and stability, making it well-suited for large-scale data processing in the digital economy.

Copyright

© 2025 The Author(s)

Open Access

Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Download article (PDF)

TY  - CONF
AU  - Sinian Chen
PY  - 2025
DA  - 2025/05/26
TI  - Design and Optimisation of Distributed Data Processing Platform Driven by Digital Economy
BT  - Proceedings of the 2025 5th International Conference on Informatization Economic Development and Management (IEDM 2025)
PB  - Atlantis Press
SP  - 184
EP  - 190
SN  - 2352-5428
UR  - https://doi.org/10.2991/978-94-6463-724-3_18
DO  - 10.2991/978-94-6463-724-3_18
ID  - Chen2025
ER  -