پیوندهای مفید
اخبار و اعلانات
آمار
| تعداد نشریات | 158 |
| تعداد شماره‌ها | 6,226 |
| تعداد مقالات | 67,708 |
| تعداد مشاهده مقاله | 115,012,944 |
| تعداد دریافت فایل اصل مقاله | 89,697,456 |
On the optimization of Hadoop MapReduce default job scheduling through dynamic job prioritization | ||
| Journal of Algorithms and Computation | ||
| دوره 52، شماره 2، اسفند 2020، صفحه 109-126 اصل مقاله (1.06 M) | ||
| نوع مقاله: Research Paper | ||
| شناسه دیجیتال (DOI): 10.22059/jac.2020.79266 | ||
| نویسندگان | ||
| Narges Peyravi1؛ Ali Moeini* 2 | ||
| 1Department of Computer Engineering and Information Technology, Faculty of Engineering, University of Qom, Qom, Iran | ||
| 2Department of Algorithms and Computation, School of Engineering Science, College of Engineering, University of Tehran | ||
| چکیده | ||
| One of the most popular frameworks for big data processing is Apache Hadoop MapReduce. The default Hadoop scheduler uses queue system. However, it does not consider any specific priority for the jobs required for MapReduce programming model. In this paper, a new dynamic score is developed to improve the performance of the default Hadoop MapReduce scheduler. This dynamic priority score is computed based on effective factors such as job runtime estimation, input data size, waiting time, and length or bustle of the waiting queue. The implementation of the proposed scheduling method, based on this dynamic score, not only improves CPU and memory performance, but also reduced waiting time and average turnaround time by approximately $45\%$ and $40\%$ respectively, compared to the default Hadoop scheduler. | ||
| کلیدواژه‌ها | ||
| Hadoop MapReduce؛ Job scheduling؛ prioritization؛ dynamic priority score | ||
|
آمار تعداد مشاهده مقاله: 228 تعداد دریافت فایل اصل مقاله: 197 |
||