In the recent years data processing in Big Data applications are moving from a batch processing model to a live streaming processing model. The live streaming processing model allows to process data in a real time or near real time manner. In many cases, there are need of combining data from various sources - both new generated data and data previously gathered and archived. In each case a different storage mechanism is appropriate to achieve best flexibility and to avoid the so-called bottleneck when processing data. In this article we review some of the possibilities of using Apache Kudu and NoSQL Redis systems which made them suitable to be used together for fast processing of streaming data.
Apache Kudu Datasheet (2017). [Online] Available from: https://www.cloudera.com/content/dam/www/marketing/resources/datasheets/cloudera-kudu-datasheet.pdf.landing.html [Accessed 10/10/2020]
Apache Kudu Schema Design (2019). [Online] Available from: https://kudu.apache.org/docs/schema_design.html [Accessed 10/10/2020].
Balabanova, I., Georgiev, G., et al. (2016). Classification of Teletraffic Service Devices by K-NN, ANFIS and ANN Classificators. IEEE International Black Sea Conference on Communications and Networking (BlackSeaCom), pp.1-5. doi:10.1109/BlackSeaCom.2016.7901585
Bulut F., & Erol M.H. (2018). A Real-Time Dynamic Route Control Approach on Google Maps using Integer Programming Methods. International Journal of Next-Generation Computing, 9(3), pp.189-202.
Clouder, A. (2018). Combining Redis with Hadoop and ELK for Big Data. [Online] Available from: https://www.alibabacloud.com/blog/combining-redis-with-hadoop-and-elk-for-big-data_582482 [Accessed 10/10/2020]
Dimitrov, G., Panayotova, G., Garvanov, I., et al. (2016). Performance analysis of the method for social search of information in university information systems. In 3rd International Conference on Artificial Intelligence and Pattern Recognition (AIPR), Lodz, Poland, IEEE, pp.149-153. doi:10.1109/ICAIPR.2016.7585228
Georgiev G., Balabanova I., et al. (2018). Identification of Sine, Squire, Triangle and Saw-tooth Waveforms with Uniform White and Inverse F Noises by Adaptive Neuro - Fuzzy Interface System. Journal of Engineering Science and Technology Review. 11(3), pp.128–132. doi:10.25103/jestr.113.17
Iliev, P., Salov, V., & Petrov, P. (2010). Virtualni sistemi. Varna: Nauka i ikonomika,
Introducing Apache Kudu. Architectural Overview. [Online] Available from: https://kudu.apache.org/docs/ [Accessed 10/10/2020]
Kostadinova, I., Toshev, R., et al. (2018). Temporal Analysis of the Pedagogical Adoptions use and Application of the Augmented and Virtual Reality Technologies in Technical Subject Areas. In 11th Annual International Conference of Education, Research and Innovation, ICERI2018 Proceedings, Seville, Spain: IATED, pp.4387-4393.
Lipcon, T., Alves, D., Burkert, D., et al. (2015). Kudu: Storage for fast analytics on fast data. Cloudera, inc, 28. [Online] Available from: https://kudu.apache.org/kudu.pdf [Accessed 10/10/2020]
Malkawi, R., Saifan, A. A., et al. (2020) Data Mining Tools Evaluation Based on their Quality Attributes. International Journal of Advanced Science and Technology, 29(3). pp.13867-13890.
Marcu, O. C., Costan, A., Antoniu, G., et al. (2017). Towards a unified storage and ingestion architecture for stream processing. In 2017 IEEE International Conference on Big Data (Big Data), IEEE, pp.2402-2407.
Michele, P., Fallucchi, F., & De Luca, E. W. (2019). Create Dashboards and Data Story with the Data & Analytics Frameworks. In Research Conference on Metadata and Semantics Research, Springer, pp.272-283.
Panayotova, G., Dimitrov, G., et al. (2016). Modeling and data processing of information systems. In 3rd International Conference on Artificial Intelligence and Pattern Recognition (AIPR), Lodz, Poland, IEEE, pp.154-158. doi:10.1109/ICAIPR.2016.7585229
Pashev, G., Rusenova, L., Totkov, G., & Gaftandzhieva, S. (2019). Business Process Modelling & Execution Application in Work Education Domain. TEM Journal, 8(3), pp.992-997. doi:10.18421/TEM83-42
Petrivskyi, V., Dimitrov, G., Shevchenko, V. et al. (2020). Information Technology for Big Data Sensor Networks Stability Estimation. Information and Security, 47(1), pp.141-154. doi:10.11610/isij.4710.
Petrov, P. (2008). Sarvarno programirane. Varna: Nauka i ikonomika.
Petrov, P., & Valov, N. (2019). Digitalization of Banking Services and Methodology for Building and Functioning of Fintech Companies. Izvestia Journal of the Union of Scientists - Varna. Economic Sciences Series, 8(1), pp.110-117. doi:10.36997/IJUSV-ESS/2019.8.1.110
Petrov, P., Buevich, A., Dimitrov, G., et al. (2019). A Comparative Study on Web Security Technologies Used in Bulgarian and Serbian Banks. In 19 International Multidisciplinary Scientific Geoconference SGEM 2019: Conference Proceedings, 19(2.1), pp.3-10.
Petrov, P., Dimitrov, P., et al. (2020). Using the Universal Two Factor Authentication Method in Web Applications by Software Emulated Device. In 20 International Multidisciplinary Scientific Geoconference SGEM 2020: Conference Proceedings, 20(2.1), pp.403-410. doi:10.5593/sgem2020/2.1/s07.052
Petrova, S., Stefanov, S., Ivanov, S., Sergeev, A., & Getova, I., (2019). Information systems used in Bulgarian university libraries as online public access catalogs. International Multidisciplinary Scientific GeoConference Surveying Geology and Mining Ecology Management, SGEM, 19(2.1), pp.353-360. doi:10.5593/sgem2019/2.1/S07.046
Quinto, B. (2018). High Performance Data Analysis with Impala and Kudu. In Next-Generation Big Data. Apress, Berkeley, CA. pp.101-111
Shook, A. (2013). Making Hadoop MapReduce Work with a Redis Cluster. [Online] Available from: https://tanzu.vmware.com/content/blog/making-hadoop-mapreduce-work-with-a-redis-cluster [Accessed 10/10/2020]
Vasilescu, C., Suciu, G., & Pasat, A. (2019). A New Method to Help the Human Resources Staff to Find the Right Candidates, Based on Deep Learning. In The International Scientific Conference eLearning and Software for Education, "Carol I" National Defence University, v.3, pp.240-246. doi:10.12753/2066-026X-19-170
Wang, K., Bian, B., Cao, P., & Riess, M. (2017). Experiences and Lessons in Practice Using TPCx-BB Benchmarks. In Technology Conference on Performance Evaluation and Benchmarking, Springer, pp.93-102.
