10 Lessons Learned In 10 Years Of Data [1/2]
It’s the end of 2022, and a common tradition in the data community is to predict trends in 2023. But what do you need for predictions? Data. And looking solely at 2022 will not help us too much to give accurate predictions. So let’s go back to 2012.
I’ll highlight my lessons learned, and you draw your own prediction for 2023. Don’t worry; some will be obvious. And, of course, there will be memes.
2012 ⏱️ Meet Bob, the Big data engineer
Bob is happy. His company just invested in an on-premise Hadoop cluster. No more proprietary BI tools. They will be dead in a few years, anyway (right!?). Bob is happy to care about distributed systems rather than business value.
A few months, system engineers, and thousand of $$$ later, the cluster is finally ready.
Bob is thinking: “Oh, it would be nice to have a service that does that for us, but what will we do then? It will steal our jobs!”
✔️ Lesson #1: Cloud didn’t take our job