Senior Devops Engineer - Big Data Infrastructure

Netflix, Los Gatos, California

Leading subscription service for watching TV episodes and movies

At Netflix, the big data platform is the foundation for all product decisions that directly impact customer experience. The platform is leveraged across the company to build data models for recommendations, analyzing customer streaming experience, content take-rate, plus more. It is critical to the success of our business as we rely heavily on analyzing data to revolutionize internet TV!

Our platform runs tens of thousands of jobs and processes hundreds of billions of events each day. We have one of the largest petabyte scale data warehouses in the public cloud. Here is a glimpse of our architecture and what we do in the the big data space!

We are looking for a devops engineer to be part of the big data infrastructure team. In this role, you will be driving operational excellence of the big data platform through tooling and automation. This is a unique opportunity to learn and work with one of the largest big data infrastructures in the public cloud, plus you will be able to contribute to open source projects.

Specifically, you will:

  • Design and own the network topology and security policies for our AWS big data environment.
  • Innovate with the Spinnaker team on cloud deployment for large scale distributed data processing applications like Hadoop, Presto, etc.
  • Help integrate our big data infrastructure with Netflix insights infrastructure, including our Atlas telemetry platform and Winston diagnostic and remediation platform, etc.
  • Help transform our Hadoop infrastructure to a container based architecture.
  • Help facilitate performance analysis and capacity planning for our AWS infrastructure.

About you:

  • You have 5+ years of experience in deploying and managing large-scale distributed systems.
  • You are passionate in building tools and automation to make infrastructure more robust.
  • You are an expert in Python or equivalent languages and you are proficient in Linux.
  • You have experience with cloud computing platforms (e.g. AWS, Microsoft Azure, Google App Engine, etc.).
  • Most importantly, you are thrilled to help us build a robust big data infrastructure and help revolutionizing internet TV!

About Netflix

Netflix is the world’s leading Internet television network with over 100 million members in over 190 countries enjoying more than 125 million hours of TV shows and movies per day, including original series, documentaries and feature films. Members can watch as much as they want, anytime, anywhere, on nearly any Internet-connected screen. Members can play, pause and resume watching, all without commercials or commitments.

Want to learn more about Netflix? Visit https://www.netflix.com/