For as long as we’ve been talking about services, we’ve been talking about data. In fact, before we even had the word microservices in our lexicon, back when it was just good old-fashioned service-oriented architecture, we were talking about data: how to access it, where it lives, who “owns” it. Data is all-important—vital for the continued success of our business—but has also been seen as a massive constraint in how we design and evolve our systems.
Modern data requirements are real time. This is the case with processing online transactions or social media feeds, capturing Internet of Things (IoT) data, or generating “just-in-time” or instant analytics on any type of database transaction. Rapid, incremental, and high-volume changes in data require ultra-fast replication or processing. Traditional batch process database transactions, often slowing or pausing produced replication on source databases. Batch processes struggle to support real-time and continuous changes in databases.
It’s an exciting time for Apache Kafka. Kafka is being used by tens of thousands of organizations, including over a third of the Fortune 500 companies. It’s among the fastest growing open source projects and has spawned an immense ecosystem around it. It’s at the heart of a movement towards managing and processing streams of data.
Why a book about logs? That’s easy: the humble log is an abstraction that lies at the heart of many systems, from NoSQL databases to cryptocurrencies. Even though most engineers don’t think much about them, this short book shows you why logs are worthy of your attention.
Based on his popular blog posts, LinkedIn principal engineer Jay Kreps shows you how logs work in distributed systems, and then delivers practical applications of these concepts in a variety of common uses—data integration, enterprise architecture, real-time stream processing, data system design, and abstract computing models.
Go ahead and take the plunge with logs: you’re going to love them.
There’s profound strategic potential in an event streaming platform for enterprise businesses of many kinds. The types of business challenges’ event streaming is capable of addressing include driving better customer experience, reducing costs, mitigating risk, and providing a single source of truth across the business. It can be a game changer.
Here are the five crucial steps to turning event streaming into a business driver and digital transformer.
