Lead Data Engineer

Ex Parte, Inc

$120K — $150K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 3+ years experience with RDBMS and T-SQL
  • 3+ years experience with NoSQL and DataLakes
  • 3+ years knowledge of Spark, Python, or Scala
  • Deep expertise in database schema design, optimization, and scalability
  • Experience with Azure or AWS cloud-based service-oriented architecture
  • Strong analytical and problem-solving skills
  • Ability to learn and adapt quickly to new technologies and environments

Responsibilities

  • Lead a team focused on the AI self-service portal and associated microservices
  • Collaborate with product owners and data experts to develop client-focused products
  • Build and maintain a distributed platform for ExParte data
  • Support data pipelines across product offerings
  • Evaluate software options and document implementation strategies
  • Work with data analysts to enhance data collection and automation
  • Guide the team's software engineering practices and perform code reviews

Benefits

  • Opportunity for career advancement into ML/AI or back-end roles
  • Flexible work environment with a distributed team across North America and Europe
  • Engagement with cutting-edge technologies like Azure and Databricks
  • Collaborative work culture with cross-functional teams
  • Access to mentorship from experts in the field
Full Job Description
Job Description

You'll lead a team that owns the AI self-service portal and the related set of microservices. You'll work with a cross-functional team of engineers to contribute to our data platform. The role also offers the opportunity to grow into either more back-end or ML/AI work depending on your interests and experience.

In this role, you can expect to:
• Work directly with product owners and data experts to build products that solve to solve complex client problems
• Build and support a distributed platform supporting all ExParte data
• Work across our product, primarily on the data pipelines
• Interface directly with internal teams
• Evaluate software and implementation options and document them for technical teams
• Work with data analysts to collect insight on possible data collection efficiencies and identify automation potential for manual workflows
• Integrate best qualitative practices in program design and development.
• Be a part of a distributed team (we're in North America and Europe)
• Work with Azure cloud and Databricks
• Develop technical architectures and specific implementations to meet business needs.
• Guide the team's software engineering best practices by documenting standards and completing code reviews.
• Troubleshoot new and existing code and provide feedback and solutions to structural issues in the codebase as they arise.
• Advise on the feasibility of nonfunctional requirements and ensure the successful implementation of features while meeting those requirements.

Qualifications

Requirements:
• 3+ years experience with RDBMS and T-SQL.
• 3+ years experience with NoSQL and DataLakes.
• 3+ Knowledge of Spark, Python, or Scala
• Strong familiarity with map/reduce programming models
• Proficiency in writing production-quality code
• Deep expertise in database schema design, optimization, and scalability
• Experience with Azure or AWS cloud-based service-oriented architecture
• Solid understanding of testing pyramid (unit, integration, black box, service)
• Experience working in an Agile/Scrum environment
• Strong analytical and problem-solving skills
• Good time management and organizational skills
• Ability to work on challenging issues independently or in a team environment
• Ability to learn and adapt quickly to new technologies and environments
• Strong communication skills

Nice-to-have's:
• Experience with Databricks or Azure ML
• Experience applying machine learning algorithms to solve complex data mining problems
• Experience with BI tools
• Understanding of cloud platforms and providers and DevOps
• Bachelor's Degree in Computer Science, Engineering, Mathematics or related field

Additional Information

Similar Jobs

More Jobs at Ex Parte, Inc

  • Lead Data Engineer
    $120K — $150K *
    Bethesda, MD 20814 (Montgomery County)
    Information Technology
    In-Person

More Information Technology Jobs

Find similar Lead Data Engineer jobs: