Uncubed

Software Engineer, Data Engineering

Lyft, San Francisco, CA

Lyft is your friend with a car, whenever you need one


Here at Lyft, Data is the only way we make decisions. It is the core of our business, helping us create an exceptional transportation experience for our customers and providing insights into the effectiveness of our product launch & features.

As a Data Engineer at Lyft, you will be a part of an early stage team that builds the data transport, collection and storage, and exposes services that make data a first-class citizen at Lyft. We are looking for a Data Engineer that is passionate and motivated to make an impact in creating a robust and scalable data platform. In this role, you will have ownership of the company’s core data pipeline that powers Lyft’s top line metrics; You will also leverage data expertise to help evolve data models in various components of the data stack; You will be working on architecting, building, and launching highly scalable and reliable data pipelines to support Lyft’s growing data processing and analytics needs. Your efforts will allow accessibility to business and user behavior insights, leveraging huge amounts of Lyft data to fuel several teams such as Analytics, Data Science, Marketplace and many others.

RESPONSIBILITIES

  • Owner of the core company data pipeline, responsible for scaling up data processing flow to meet the rapid data growth at Lyft
  • Consistently evolve data model & data schema based on business and engineering needs
  • Implement systems tracking data quality and consistency
  • Develop tools supporting self-service data pipeline management (ETL)
  • SQL and MapReduce job tuning to improve data processing performance

EXPERIENCE AND SKILLS

  • Extensive experience with Hadoop (or similar) Ecosystem (MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, Parquet)
  • Proficient in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle)
  • Good understanding of  SQL Engine and able to conduct advanced performance tuning
  • Strong skills in scripting language (Python, Ruby, Perl, Bash)
  • Experience with workflow management tools (Airflow, Oozie, Azkaban, UC4)
  • Comfortable working directly with data analytics to bridge business requirements with data engineering

BONUS POINTS

  • MPP database experience (Redshift, Vertica, Teradata)
  • Experience with building tools to support self-service pipeline
  • Experience with one of the messaging system (Kafka, SQS, Kinesis) and different data serialization (json, protobuf, avro)

Lyft is an AA/EEO employer that actively pursues and hires a diverse workforce, and pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

About Lyft

Wherever you’re headed, count on Lyft for rides in minutes. The Lyft app matches you with local drivers at the tap of a button. Just request and go.

Ride by ride, we’re changing the way our world works.

Want to learn more about Lyft? Visit https://www.lyft.com/