Senior Software Engineer - Data Platform
Discord, 444 De Haro St
We built Discord to bring gamers together
Discord is one of few places that combine who you play games with and how you play those games. We use this data to make Discord the best place to play games with your friends.
Join our Data Platform team to build a scalable data platform that powers features and informs teams. Help us build scalable distributed systems like you'd construct additional pylons in your base. You build those in your sleep, amirite?
What you'll be doing
- Help us build a robust and scalable foundation for data, from logging & ingestion to streaming & batch pipelines, as well as the tools that every team uses to interface with it.
- Build the platform that empowers our Data Science, Machine Learning & Analytics teams, as well as powers product features used by millions of users every day.
- Own and operate our entire data stack using modern technologies such as Apache Beam, Kafka, Pub/Sub and Airflow.
- Work closely with our backend and frontend engineering teams to log & ingest data into our platform and produce a robust high-quality data feed.
- Build efficient solutions on top of GCP and AWS using Python, Scala and Go.
What you should have
- Minimum of 4 years experience building scalable backend systems.
- Experience working on, and deploying, large-scale systems in Python or Go, Scala/Java, or other similar languages.
- Experience working with and managing varied forms of distributed data systems such as Kafka, Storm or Spark.
- Love to work with high volume heterogenous data and distributed systems.
- Self-motivation and the ability to take a high-level goal and deliver shippable code.
- Proven track record of working with petabyte-scale data infrastructure. Discord has plenty of it.
- Experience working with varied data applications and databases, such as Hadoop, BigQuery, Spark or Redshift.
- Expert knowledge of SQL, MapReduce and/or statistics scripting tools (i.e. R).
- BS/MS/PhD in Computer Science, Applied Mathematics or a related field.
- Godlike pylon construction skills.
About us Discord is the all-in-one voice and text chat app designed specifically for gamers. It's free, secure, and works on both desktop and phone. Our mission is to bring gaming communities together. Discord's free voice and text chat is about making it easier for you spend time with the people you care about, create these memories, and land a headshot or two. Two hundred seventy million PC gamers use chat apps to communicate while playing online games. As gamers, we got fed up with many of these chat tools and decided to fix the problem ourselves. As a result, we've built the best all-in-one voice and text chat app for gamers. Fortunately, a lot of people love it. Discord currently has 45 million registered users with over 9 million Daily Active Users. The service sees 200 million messages posted a day, over 4 million peak concurrent players and a staggering 16 petabytes of voice chat data going through its servers every month. Founded by the team behind OpenFeint - a networking platform that united mobile games with achievements and social functionality - Discord has raised over $30M from top VCs like Greylock, Benchmark, Accel, and Tencent.