Senior Distributed Systems Engineer - Big Data Infrastructure
Netflix, Los Gatos, California
Leading subscription service for watching TV episodes and movies
Specifically, you will help:
- Architect and build new microservices that help manages our rapidly growing 60+ PB data hub on AWS S3.
- Architect and build federated metadata services (like Metacat) to manage metadata and lineage across all data sources we support (e.g., Kafka, Cassandra, RDS, Redshift.)
- Build and evolve our federated job management (RESTful) service, Genie, to manage job executions in various open source data processing engines like Presto, Spark, Hive, Pig, Sqoop, etc.
- Improve efficiency, reliability and scalability of our data ingestion pipelines. Currently, one of our distributed data pipelines ingests hundreds of billions of events from Kafka into S3 with a 5 minute SLA.
- Lead cross-functional initiatives and collaborate with engineers across organizations.
- Help contribute to our services and tools on Netflix OSS. Share our experiences and collaborate with the open source communities.
- You have 6+ years of experience in building large scale distributed applications.
- You are proficient in design and development of RESTful web services.
- You are an expert in Java. Python expertise is a plus.
- You have a BS/MS/PhD in Computer Science or related field.
- Most importantly, you are thrilled to help solve our big data challenges while revolutionizing internet TV!
Netflix is the world’s leading Internet television network with over 100 million members in over 190 countries enjoying more than 125 million hours of TV shows and movies per day, including original series, documentaries and feature films. Members can watch as much as they want, anytime, anywhere, on nearly any Internet-connected screen. Members can play, pause and resume watching, all without commercials or commitments.
Want to learn more about Netflix? Visit https://www.netflix.com/
Jobs You May Like
Senior DevOps Engineer (AWS)
Weedmaps, Tucson, Arizona, United States
Senior Security Engineer
TripAdvisor, Needham, MA
Staff Software Engineer - Search
Reddit, San Francisco
Platform Engineering Manager
Animoto, New York, New York
Control Engineer Specialist for Production Lines (m/f)
Black Box QA Engineer (Contract)
PlayStation, San Francisco, CA