I've been working on data-intensive applications for the past 5 years, exploring new technologies and meeting new challenges.
I spend the first 2.5 years with a company called Trovit, working on real-time bidding. We developed a service that enabled bidding around 10k queries per second, which worked by using batch processes in Kafka + hdfs + hadoop to do the calculations. Next, a lightweight Netty server fetched the information from Redis and replyed to all the requests as fast as possible (Google has a limit of 300ms with network time included).
At the end of my time in Trovit, I was working with Spark and Scala.
For the last 2.5 years, I've been working for Zopa as part of a team split between London and Barcelona. Over this time, the team had an efficient and communicative remote relationship, conducting all our team programming and project planning over the internet. Our primary task was to refactor the old monolith into a structure with microservices, based on event-driven communication. Here, We built all the services using Ratpack, Kafka, Docker, K8s, among others.
Besides my professional work, I have a couple of side projects, including one that I'm currently developing in my spare time HistoryPuzzle