Lead Data Engineer (Audience Intelligence)

Two Circles

$90K — $120K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of experience in data engineering
  • Proficiency in Python and PySpark for data processing
  • Hands-on experience with Azure tools (ADF, Databricks, Function Apps)
  • Knowledge of CI/CD pipelines using Azure DevOps or similar
  • Experience in data lakehouse environments
  • Strong SQL skills for querying and managing data
  • Excellent communication skills to engage non-technical stakeholders

Responsibilities

  • Design, build, and test scalable data platforms in Azure
  • Develop high-quality data products focusing on efficiency and performance
  • Collaborate with product and marketing teams for data-driven insights
  • Write clean, maintainable code adhering to best practices
  • Continuously improve data workflows and monitor performance

Benefits

  • Professional growth through diverse project work
  • Opportunity to impact the sports and entertainment industries
  • Supportive and collaborative team environment
  • Culture focused on innovation and cutting-edge technology
  • Commitment to diversity and inclusion
Full Job Description
Lead Data Engineer (Azure / Databricks / Python)

What you will do

We're looking for a talented Data Engineer to join our squad of >100 Data & BI Engineers, working on our Audience Intelligence Platform. You will be helping to build the leading data management and analytics platform for the sports industry. In this role, you'll work with cutting-edge technologies to design, build, and optimize scalable data solutions, enabling teams, leagues, and organizations to unlock the full potential of their data. If you're passionate about data engineering, enjoy collaborating in a fast-paced environment, and want to make an impact in the sports industry, we'd love to hear from you!

Your role will be varied and evolve as quickly as you can learn and develop. Your initial duties will involve:

  • Design, build, and test scalable data platform solutions in Azure, leveraging tools like ADF, Databricks, and Function Apps, using Python.
  • Develop high-quality data products, ensuring efficiency, reliability, and performance across our data pipelines.
  • Collaborate closely with product and marketing teams to deliver data-driven insights and solutions that provide high business value.
  • Write clean, maintainable code following best practices and development frameworks, ensuring robust data engineering standards.
  • Continuously improve and optimize data workflows, monitoring performance and implementing enhancements to drive innovation.

Requirements

Requirements

You will have experience with the following:
  • Experience in designing, building, and testing solutions within a data lakehouse environment.
  • Proficiency in Python and PySpark for data processing and analytics.
  • Hands-on experience with Azure, preferably ADF, Databricks, and Function Apps.
  • Familiarity with CI/CD pipelines using Azure DevOps or similar tools.
  • Ability to work within established development frameworks and adhere to coding standards.
  • Excellent communication skills, with an ability to articulate blockers and timelines to non-technical stakeholders.


While the above skills are important to this role, we believe that attitude and ability to learn new skills are the most important factors for success in this team. If you are missing some of the experience listed above but this sounds like you, we'd love to hear from you.

  • Strong teamwork skills, with a collaborative mindset and desire to learn from others.
  • Strong SQL skills for querying and managing data.
  • A proactive attitude with a passion for continuous learning and growth.
  • High attention to detail and commitment to delivering quality work.
  • Comfortable working in a fast-paced environment, with the ability to estimate tasks and deliver incremental value effectively.

Benefits

Professional Growth: Work on a variety of projects, enhancing your testing skills across different applications and technologies.

Impactful Work: Play a key role in delivering high-quality solutions that shape the future of the sports and entertainment industries.

Collaborative Environment: Be part of a team that values ideas, fosters a supportive atmosphere, and encourages continuous learning and improvement.

Innovative Culture: Join a company committed to revolutionizing fan and stakeholder engagement through cutting-edge technology.

The range below represents the low and high end of the base salary someone in this role may earn as an employee of Two Circles. Salaries will vary based on various factors including but not limited to professional and academic experience, training, associated responsibilities, and other business and organizational needs. The range listed is just one component of our total compensation package for employees. Salary decisions are dependent on the circumstances of each hire.

Similar Jobs

More Jobs at Two Circles

More Information Technology Jobs

Find similar Lead Data Engineer (Audience Intelligence) jobs: