Uncubed
           

Kafka DevOps Engineer (Platform Services)

Schibsted, Barcelona

See jobs at Schibsted


Schibsted Marketplaces empower the world’s economy and promote sustainability by enabling anyone to sell and everyone to buy, connecting people to new opportunities and great deals every day. Our goal is to provide fantastic value to all of our 30 million daily users across 22 countries, with effective and safe online classified ads.

Platform Services

Our systems are global-scale deployments of different services such as developer productivity tools, image and message processing systems, active and passive security scanning, big data and mapreduce clusters, messaging brokers, database and NoSQL backends and many more. We specifically have to support hundreds of services and hundreds of instances for our millions of consumers, using service discovery systems, autoscaling, dynamic load balancing and routing.

Scientists and engineers in our teams work to make hundreds of millions of user behaviour events from all around the world understandable for analysts and business users in the company, daily. This large data set is also one of the most diverse data sets in the world and we work with the latest data technologies (Spark, AWS services, Kafka). Tens of thousands of tasks are ran every day to handle data processing jobs at this scale.

For internal services (like delivery pipelines and build systems), we support more than a thousand developers and develop dozens of developer productivity utilities to have our developers code more with less hassle. At all times our engineers are just a git clone away from real code and our teams are active contributors to several public OSS projects.

Responsibilities

  • As part of the Storage Team within Schibsted you will be in charge of developing, deploying, maintaining, supporting  a state-of-the-art Kafka platform managed As a Service
  • Automating the operations and production of the minimizing manual intervention as much as possible
  • Advise and train the adopters of the Kafka platform about usage and best practices.
  • Help develop the best possible continuous delivery pipelines supporting features like automated promotion to production, automated canary releasing or blue green deployments
  • Forensic analysis and troubleshooting when things go wrong
  • Be part of the engineering organisation, set up guidelines, help other team to make design / reliability trade offs and implement systems that fail over gracefully and transparently to clients
  • Implement monitoring and logging solutions that enable the production systems to be monitored 24/7
  • Respond to requests from other teams by building self-service solutions
  • Make sure that any tech solution that you put in place is robust, will scale, and failover / BCP systems are in place
  • Liaise with 3rd parties to evaluate technology that Schibsted needs

Requirements

  • A BSc degree in computer science or equivalent experience.
  • Strong knowledge and experience in Managing Kafka Infrastructure is required.
  • Experience with cloud providers (AWS, GCP, Azure, DigitalOcean)
  • Strong analytical / problem solving skills.
  • Good UNIX background
  • The ability to write scripts to diagnose problems ( Python, Ruby, Bash or similar)
  • Proven ability and experience developing computer programs  (Golang, Java, Python, Ruby or similar)
  • Experience in building systems that scale is required
  • Experience with Continuous Integration and Immutable Deployments

About Schibsted

About us SHAPING THE MEDIA OF TOMORROW. TODAY. Schibsted is an international media group with 7,300 employees in 22 countries.Our strategy to become a global leader within our fields is bold. It consists of three elements that work seamlessly together: Classifieds, Growth and Media Houses. We aim to be a global leader in online classified marketplaces and offer the best solutions and services for our users. We invest in great entrepreneurs and help scale their businesses locally and internationally by leveraging the Schibsted ecosystem. We are building world class digital media houses that will shape the media landscape for years to come. Schibsted Media Group has a global reach with both global challenges and global opportunities. We are constantly looking for great talents to help us challenge the present: Developers in Paris, UX-designers in Stockholm, sales people in Sao Paulo and key account managers in Madrid. Why don't you check out the opportunities we are currently offering? We want to hear from you!

Want to learn more about Schibsted? Visit Schibsted's website.