In the first part of this series we talked about the ETL bias and the problems it brings to the way Data is perceived and managed in companies. The first chapter ended with the following question that is going to be the motivation for this second part.
“If Data is the most precious asset in a company, does it make sense to have only one team responsible for it?”
The answer is of course no and if you ask around in your company they probably have the same feeling. However, if you look around you will probably find a Data…
[Second part is now live – https://link.medium.com/f6Ixe9Htbhb]
This is the first article of the Building Data Platforms series. Why doing this in the first place you might be asking? It is simple. If you step back and look at the way the software industry approaches Data you see it has not fundamentally changed if we compare to other shifts that happened in the last 10–15 years. We got new tools such as Kafka, Spark, Flink and Snowflake but we haven’t changed the mindset of how we build Data Platforms. …
Every now and then, I ask myself the same question.
What important truth do very few people agree with you on? — Peter Thiel
Before writing this, I spent a lot of time applying this question to a topic that’s very trendy nowadays, microservices. I believe I have found some interesting insights, some based on some reflections and others from real experiences, that I will share with you today.
Let’s start with the important truth, our north star, that will guide us on this journey.
Most implementations of microservices are nothing more than distributed monoliths.
Every system starts with a…
I have been thinking about the future in various angles of my own lense of reality. Some thoughts scare me, others make me believe we can solve some of the biggest problems humanity has. How will our lives be 10, 20 years from now? How will we communicate, work, move, love and express ourselves? These questions and a lot more have been on my mind and I am happy to start sharing them with you. Together, we will stop and think about the world we want to create. Welcome aboard.
The first stop in our journey will be to talk…
Every new internet startup can be seen as an act of creation. You start small with a limited scope: a small web app (e.g Rails) and a database. Assuming you’re lucky, your little startup begins to grow and you need to develop additional systems to provide the functionalities that your customers demand. This growth, although exciting, brings additional complexity, mainly in the interactions and dependencies between the new systems being developed.
Does this movie sound familiar to you? Let me tell you, you’re not alone. Around 2011, Linkedin was facing similar issues as you can see in the figure below.
Last year I closed my first startup and decided to share some personal lessons I have learned during that time. Today, I am going to talk to you about what happened next.
After two months of holidays, I decided that it was time to do something useful for the world.
“The wind cannot defeat a tree with strong roots” — Hugh Glass in the Revenant
The problem was: I had no idea what I wanted to do.
I had some ideas for some new projects but I had no team, despite having some really awesome mentors I regret not having…
This text is part of my WOW for the Thousand Network 2016 application
Hey there! I am João, a (software) engineer who likes to solve big problems, using technology and anything else that is useful, that affect lives of everyone living on this amazing planet called Earth.
The last times I wrote something here was about two not-so-positive episodes in my life: surviving certain death when a car hit me and reflecting about my first big failure as an entrepreneur.
Today, I am happy to write to you a little bit more about myself: three personal aspects and stories that…
Life is made of chapters and “everything that has a begining has an end”. At the time I’m writing this, I have closed an important chapter of my life: my first startup. In other words, it failed. I failed.
Since I was very young I always liked to build things. I think I was 6 when I went with my grandfather to the train factory he managed. Despite all the big trains and electricty stuff (which I loved), what really impressed me was his passion and how other people respected him. …
Data @Unbabel | Past: Talkdesker @talkdesk |1x startup founder| Employee #2 @Uniplaces. Taekwondo black belt