Lead Data Engineer

Two Circles

$90K — $120K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 8+ years in software engineering with a data focus in fast-paced environments
  • 5+ years experience in writing and refining database queries
  • 5+ years with object-oriented languages (Python and C# .Net)
  • 5+ years maintaining cloud infrastructure, preferably AWS
  • 3+ years in automating repetitive tasks such as setups and data movement

Responsibilities

  • Work with a cross-functional product team to build a SaaS data platform
  • Design and implement data pipelines focusing on quality and reliability
  • Collaborate with Product Management and stakeholders on data strategy
  • Advocate for development best practices through design reviews and testing
  • Contribute to a DevOps culture and manage production operations
  • Support maintenance and operations of the data platform

Benefits

  • Professional growth through diverse project experience
  • Impactful work delivering solutions for sports and entertainment
  • Collaborative environment that values ideas and learning
  • Innovative culture transforming fan and stakeholder engagement through technology
Full Job Description
Two Circles is looking for a Data Engineer to join our dynamic KORE Intelligence Platform team. In this role, you'll be a key part of our Partnership Intelligence > Measurement Team that specializes in the ingestion, transformation, and storage of large-scale social and broadcast data. Working under the guidance of an experienced Data Engineers and Architects, you will gain hands-on experience designing and maintaining scalable, efficient data pipelines that support enterprise web applications, analytics, and business intelligence.

About The Role

We are seeking a Lead Data Engineer to join our Measurement team in the Partnership Intelligence Platform. You will round out the team with expertise in directly managing AWS Services, with technologies such as Airflow, Snowflake, MS SQL Server and .Net. Experience designing and managing large scale data pipelines is a must for this role, as well as a keen interest to explore new technologies and solutions. We are looking for someone who brings experience and passion working with the flow of data and infrastructure.

Key Responsibilities
  • Work as part of a cross-functional product team to deliver a high-quality SaaS based data platform.
  • Design and implement data pipelines with a clear focus on data quality and reliability.
  • Partner with both Product Management and stakeholders, as well as both technical and non-technical team members to deliver our vision, roadmap, and data strategy in addition to innovative client solutions.
  • Act as an advocate for development best practices including technical design reviews, implementing test plans, test driven development, monitoring/alerting, peer code reviews, and documentation.
  • Contribute to our DevOps culture and participate in ownership of our designs through production operations.
  • Support the ongoing maintenance and operations of the data platform.


Ideal Tech Stack:
  • .Net / C#
  • Python
  • AWS or similar
  • Snowflake
  • SQL
  • Airflow

Requirements

Experience
  • 8+ years of experience in software engineering with a data focus, working in a fast-paced, agile environment
  • 5+ years of experience writing, debugging and refining database queries
  • 5+ years of experience with object oriented languages (preferably Python and C# .Net)
  • 5+ years of experience building or maintaining cloud infrastructure and services (preferably AWS)
  • 3+ years experience automating repetitive tasks (like setups, developer onboarding, support, moving data, etc.)


Technical Skills
  • Experience with various orchestration and batch processing technologies like Apache Airflow
  • Proficiency in Snowflake and MS SQL.
  • Proficiency in Python and C#. Both are required to be successful in this role
  • Strong experience with containerization such as Docker
  • Familiarity with monitoring tools for data pipeline performance such as New Relic
  • Experience developing against APIs and building scalable systems.
  • Experience with writing unit tests using frameworks such as PyTest for quality assurance.
  • Understanding architectural differences between streaming and batch-oriented integrations

Benefits

Professional Growth: Work on a variety of projects, enhancing your testing skills across different applications and technologies.

Impactful Work: Play a key role in delivering high-quality solutions that shape the future of the sports and entertainment industries.

Collaborative Environment: Be part of a team that values ideas, fosters a supportive atmosphere, and encourages continuous learning and improvement.

Innovative Culture: Join a company committed to revolutionizing fan and stakeholder engagement through cutting-edge technology.

The range below represents the low and high end of the base salary someone in this role may earn as an employee of Two Circles. Salaries will vary based on various factors including but not limited to professional and academic experience, training, associated responsibilities, and other business and organizational needs. The range listed is just one component of our total compensation package for employees. Salary decisions are dependent on the circumstances of each hire.

Similar Jobs

More Jobs at Two Circles

More Information Technology Jobs

Find similar Lead Data Engineer jobs: