DeveloperWeek 2015 Conference + EXPO

One of the primary reasons behind Hadoop’s popularity is the growing ecosystem of components built on top of its core framework that allows developers to choose the right tool to solve individual use cases instead of force fitting a sub-optimal solution to the problem. The result is a common scalable and dependable platform that web-scale cloud operations can run on.

In this talk, we will take a deeper look at the Big Data technology stack that Yahoo has built or assembled and a variety of relevant use cases from its Mobile, Search, Advertising, Personalization, Media, and Communications businesses that make these stack components indispensable for nearly 1,000 active developers on the platform. Throughout the talk, we will bring in challenges that come from scale, security and multi-tenancy considerations that Yahoo has dealt with in the last 10 years of operating the largest Hadoop footprint in the world. Finally, we will close with how the platform is fostering ongoing innovation at Yahoo in close collaboration with the open source community.