Unifying Events and Log into the Cloud with Open Source Software

  • avatar Eduardo Silva
    Eduardo Silva is a principal Open Source developer at Treasure Data Inc. It currently leads the efforts to make logging ecosystem more friendly between Embedded and Cloud Services. He also directs the Monkey Project organization which is behind the Open Source projects Monkey HTTP Server and Duda I/O. He is a known speaker in FLOSS events in South America and have serve as an organization administ
Log data provides critical insights into software systems. However, in the age of ubiquitous computing, unifying logs from hundreds of data sources with different data formats presents a big challenge. Fluentd is an open source data collector that solves this problem by providing a unified logging layer with pluggable and reliable architecture. In this presentation, I will talk about different use cases including mobile backend systems for logging and automotive sensor data collection and discuss how we can collect data from these sources in a maintainable, scalable manner, focusing on cloud-based backend systems.