Stories
June 9

Key learnings from building a distributed cache platform at Spotify

This talk discusses the experiences of building a Cloud distributed cache service with sharding and replication running in Kubernetes. The aim of this project was twofold: To reduce costs and improve the developer experience and productivity. Now the service is serving literally millions of requests per second for some tens of microservices… but the road has been bumpy at times.‍
Talk abstract

During the last year, at Spotify we’ve been building a Cloud distributed cache service with sharding and replication running in Kubernetes. Client services use our own custom Java library on top of the open source spotify/folsom Java memcached client. 

The aim of this project was twofold: To reduce costs and improve the developer experience and productivity. Now the service is serving literally millions of requests per second for some tens of microservices… but the road has been bumpy at times. In this talk I’ll share some surprising learnings about cloud-distributed systems at scale.

‍

Javier Arias
Sr. Software Engineer, Spotify

Related talks

Stories
June 8
From platform teams to a platform organization: Connecting the dots
A year ago we changed our existing platform approach. Where we (Central Platform Organisation) weren’t actually helping the developers, we needed to connect the dots. However we firstly needed to identify which dots were worthy. In this talk, we share lessons from our platform journey to improve developer experience from a fragmented approach to an integral approach; the developer journey.
Bas Vegter
Platform Engineer, Dutch Railways
Onno Wierbos
Product Owner, Dutch Railways
sponsored
Stories
June 9
Efficiency and platform engineering
Join us on a journey where we share how we transformed a complex microservices architecture into a scalable platform that manages over 26 thousand microservices and supports over 12 thousand developers, in a highly productive environment. We'll discuss the key insights we've learned including the challenges, the solutions we implemented, and the best practices we adopted.
Juliano Marcos Martins
Sr. Tech Manager, Mercado Libre
sponsored
Stories
June 9
With great self-served platform comes a greater need for multi-tenancy
This talk will be curated with the use cases, challenges, concerns and mitigation strategies experienced by the Lowe's Platform engineering team while creating, maintaining, and scaling a real-time data reporting platform.
Diganta Mukherjee
Lead Software Engineer, Lowe's Services India
sponsored
Stories
June 9
Where we went wrong in building a self-service platform on Kubernetes
In building a self-service platform on Kubernetes, we aimed to give application developers autonomy over their own services. But did we go too far in giving developers control? Join us as we explore how to find the right balance between standardization and flexibility when building a self-service platform.
Reynis Vazquez-Guzman
Sr. Software Engineer, Affirm
sponsored