Dealing with unstructured data - scaling to infinity
-
John Hammink
I'm an artist, engineer and leader, and I love to teach.
As an early (level-0) design-driven engineer and generalist on a number of major products/startups that have gone on to major success (F-Secure, Skype, Mozilla's Firefox OS), I pioneered processes and then trained up many of our engineers, teams and functions.
Web developers - or any developers, for that matter - can rarely reach consensus on how to collect the very high volume of data coming from things such as logs, sensors and impression click-throughs, when their project goes meteoric and homespun databases just aren't cutting it. What's more, they are often struggling with different schemas and formats of the data before they can even think of storing it in the cloud. In our discussion, we'll talk about ways you can collect this sort of data from your applications with relatively little extra effort, store it in an unstructured format in the cloud, and query it into the format you need for your analytics.