Posts

Showing posts with the label Apache Kafka

Introduction to Apache Kafka

Image
Hi, I am Malathi Boggavarapu working at Volvo Group and i live in Gothenburg, Sweden. I have been working on Java since several years and had vast experience and knowledge across various technologies. This post introduce you about the Apache Kafka - a large Streaming platform. So let's get started and get into the details of it. Who invented Kafka Kafka is invented by LinkedIn. They are the first ones that created the project which is now a top level Apache project which is the Open source project that has large community behind it. Why use Kafka ETL is dead. Long live streams. To introduce this topic, we look at typical data pipeline that is used at data warehousing known as Extract Transform and Load , the ETL process. So what exactly is the ETL process? Let's take a look at it now. The process starts with Data Providers . The data from these providers were loaded into staging environment every night or more frequently. The staging environment cou