The Knowledge Hub

Apache Hive is designed to give data engineers and data scientist a SQL like access to the big data available in Hadoop cluster, so we can think of it as a normal RDBMS, in normal RDBMS we have database, and ...

In this article, we will depict some skills and concepts that must be learned in the journey of becoming a data scientist but first, what is data science?  Data Science is the art of uncovering the insights and trends in ...

Hive was initially developed by Facebook in 2007 to help the company handle massive amounts of new data. At the time Hive was created, Facebook had a 15TB dataset they needed to work with. A few short years later, that ...

Introduction Talend is an open-source data integration platform. It provides different solutions and services for data integration, data quality, cloud storage, and Big Data. According to the latest Gartner report, Talend named in the leader’s quadrant among other data integration ...

ETL stands for Extraction Transform Load is a common concept in data engineering, and as we can imply from the name of the concept that this concept has three types of operations, Extract which indicate the process of extracting data ...

Introduction Apache Kafka is a scalable, high performance, low latency platform that allows reading and writing streams of data like a messaging system. We can start writing Kafka applications using Java fairly easily, check our previous article on how to design a Kafka pipeline ...