Senior Software Engineer, Data Engineering

Lucid, Chicago

See jobs at Lucid

Duration: Full-Time

Lucid is a research technology (ResTech) platform that provides programmatic access to first-party data. With respondents in more than 100 countries, Lucid enables anyone, in any industry, to survey online audiences and get the answers they need. These answers reveal the sentiments, motivations, and behaviors of target demographics – data that can be used to build business strategies, measure the impact of digital advertising, publish research, and more. Founded in 2010, Lucid is headquartered in New Orleans, LA with offices throughout the US, Europe, and Asia.

The Opportunity
Lucid seeks a Software Engineer to join our data integrations team based out of Dallas, TX. Remote positions available for US based candidates. This team is working to develop real time data structures and solving big data problems utilizing modern technologies like Python, Java/Scala, SQL, and AWS cloud environments.
This role is open to candidates living in the United States to work remotely or from one of our US-based office locations (New Orleans, Dallas, New York)

The ideal candidate for this role will have 5+ years of hands-on professional software development experience



  • Create and maintain optimal data pipeline architecture
  • Write reliable, maintainable, well-documented code that will scale to support millions of respondents
  • Execute the full software development life cycle as part of an Agile team
  • Collaborate with Product Managers to refine and modify requirements
  • Following established design paradigms and design patterns
  • Strong unit testing and integration testing practices
  • Participate in the on-call rotation to monitor shipped features for success and issues
  • Support the business teams and product managers in data extracts and data analysis
  • Demonstrate proficiency in developing software for the user interface, business logic, data modeling and systems, and component integration
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
  • Create and maintain optimal data pipeline architecture


  • Bachelor's or Master's degree in Computer Science
  • Competency in data structures, algorithms, and software design
  • Experience with high volume and high-performance web applications
  • Highly proficient SQL and Database skills
  • Ability to rapidly debug and solve problems in unfamiliar areas
  • Experience in working in an agile environment with rapidly changing requirements and tight deadlines
  • Strong verbal and written communication skills

Preferred Qualifications

  • 5+ years of hands-on software development experience in Python, Go/Golang, Java, or other modern web technologies
  • Familiarity with containerization technologies like Docker and Kubernetes
  • Experience with Amazon Web Services specifically, or any cloud host
  • Experience with microservice architecture and platforms and building RESTful APIs
  • Advanced working SQL knowledge and experience working with relational databases, noSQL, modeling and query authoring (SQL)
Key Benefits

- Eligibility for competitive Medical, Dental and Vision offerings
- 401k match investment opportunities 
- Competitive PTO policy & unlimited sick time
- Paid Holidays
- Healthy work-life balance with flexible work hours
- Competitive Parental Leave policy 
- Employee donations and philanthropic matching programs
- In-house career development opportunities

Lucid's Hiring Commitment

We understand that many candidates may not be perfectly qualified for a job posting. Experience comes in different forms; many skills are transferable – and passion goes a long way. Even more important than your resume is a clear demonstration of dedication, impact, and the ability to thrive in a dynamic, collaborative environment. We want you to learn new things in this role, and we encourage you to apply if your experience is near the desired qualifications.

We also know that diversity of background and thought can enhance problem-solving and encourage more creative thinking, which is why we're dedicated to adding new perspectives to the team.

At Lucid we foster a collaborative and inspiring workplace.  We pride ourselves in doing this by recruiting, hiring and retaining diverse, passionate, and forward-thinking talent. Lucid is committed to and encourages an inclusive environment and we are dedicated to providing equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please let us know.

About Lucid

Lucid is a data technology company focused on the power of human answers. We were founded and are based in New Orleans, Louisiana, with offices in London and Gurgaon. We’re moving fast, and growing fast – Lucid has doubled in size and revenue two years running. Let us tell you a little about our businesses and our team of over 225 people worldwide.


Want to learn more about Lucid? Visit Lucid's website.