| تعداد نشریات | 127 |
| تعداد شمارهها | 7,169 |
| تعداد مقالات | 77,056 |
| تعداد مشاهده مقاله | 155,848,067 |
| تعداد دریافت فایل اصل مقاله | 117,371,615 |
DataBay: A Unified Platform for Automating Data Warehouse Management, Real-Time Data Processing, and Ensuring Data Quality and Monitoring | ||
| Journal of Algorithms and Computation | ||
| دوره 56، شماره 2، اسفند 2024، صفحه 75-88 اصل مقاله (1.27 M) | ||
| نوع مقاله: Research Paper | ||
| شناسه دیجیتال (DOI): 10.22059/jac.2025.389920.1222 | ||
| نویسندگان | ||
| Mostafa Ghadimi* 1؛ Niyusha Baghayi2؛ Alireza Shateri2 | ||
| 1ut.ac.ir | ||
| 2databurst.tech | ||
| چکیده | ||
| As organizations increasingly depend on large-scale data for strategic decision-making, managing data warehouses has become a complex and resource-intensive challenge. This paper introduces DataBay, a unified platform designed to automate the entire data warehouse lifecycle, from data ingestion and transformation to real-time processing, monitoring, and ensuring data quality. DataBay leverages Avro for data serialization, providing optimal throughput and storage efficiency. Additionally, its automated data pipeline orchestration, along with built-in data quality checks, enhances the reliability and accuracy of insights derived from the data. The platform’s architecture is highly scalable, supporting enterprise-level datasets and adapting to evolving business needs. Through its seamless integration and flexibility, DataBay helps businesses make timely, data-driven decisions and enables continuous optimization of data workflows. This paper discusses the platform’s architecture, its implementation in real-world industry settings, and the significant business value it delivers by enhancing operational efficiency and empowering data-driven decision-making across organizations. | ||
| کلیدواژهها | ||
| Data Warehouse؛ Data Engineering؛ Real-time Data Processing؛ Data Quality؛ Data Management؛ Business Intelligence؛ Data Transformation؛ Data Monitoring؛ Scalable Data Platform | ||
|
آمار تعداد مشاهده مقاله: 241 تعداد دریافت فایل اصل مقاله: 326 |
||