Staff Software Engineer, Big Data

Cognitiv

$170K — $240K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 10+ years experience in large-scale distributed systems and data platforms
  • Expertise in Spark, Kafka, Flink, and other big data technologies
  • Proven architectural leadership with a focus on scalability and reliability
  • Ability to influence cross-functional teams without direct authority
  • Experience in cloud environments like AWS, Azure, or GCP
  • Strong problem-solving skills to address systemic technical challenges
  • Excellent communication with technical and non-technical stakeholders

Responsibilities

  • Define and evolve the architecture of a large-scale data platform
  • Lead complex, cross-functional data initiatives and align stakeholders
  • Establish long-term technical standards and modernization efforts
  • Elevate operational excellence and conduct architecture reviews
  • Guide cost-efficiency decisions for a multi-petabyte data system
  • Advance foundational data and ML platform capabilities
  • Mentor and grow engineering talent through design reviews and guidance

Benefits

  • Comprehensive health, dental, and vision plans
  • 12 weeks paid parental leave with an additional 4 weeks WFH
  • Unlimited PTO plus a Work-From-Anywhere month
  • Career development through clear advancement paths
  • Equity participation for all employees
  • Hybrid work model and daily team lunches
  • Health and wellness stipends, including cell phone reimbursement
  • 401(k) and RRSP matching programs
  • Parking and commuter benefits for certain locations
  • Robust onboarding experience through Cognitiv University
Full Job Description
The Role

As a Staff Software Engineer, Big Data, you will define and drive the long-term technical direction of the data platform that powers Cognitiv's AI-driven advertising products. You will lead the architecture and evolution of critical data systems spanning ingestion, warehousing, machine learning feature generation, identity resolution, and activation at massive scale.

As a senior technical leader, you will identify systemic challenges, align teams around durable solutions, and drive complex initiatives that span engineering, science, machine learning, and product organizations. Your work will shape the scalability, reliability, and strategic capabilities of Cognitiv's data platform for years to come.

Location: Our Vancouver office will open on September 1 in Mount Pleasant. The Founding Engineering team will work remotely through the summer. Starting September 1, the role will transition to a hybrid model: in-office Monday-Wednesday, with remote flexibility on Thursday and Friday.

Your Impact

In this role, success is measured by the durability of your technical solutions, the health of the data platform, and your influence across the engineering organization. You will:
  • Lead Platform Architecture: Define and evolve the architecture of Cognitiv's large-scale data platform, ensuring ingestion, storage, processing, and serving systems can scale to support future business growth, AI initiatives, and increasing data volumes.
  • Drive Multi-Team Data Initiatives: Lead complex, cross-functional programs spanning Data Engineering, Machine Learning, Science, and Product teams. Align stakeholders, reduce execution risk, and deliver outcomes that improve platform capabilities across the organization.
  • Shape Long-Term Technical Direction: Evaluate architectural tradeoffs with a 3-5 year horizon, establish technical standards and paved-road solutions, and drive modernization efforts that improve scalability, reliability, developer productivity, and operational efficiency.
  • Elevate Reliability and Operational Excellence: Lead architecture reviews, failure-mode analysis, and incident retrospectives. Establish mechanisms to proactively identify, prioritize, and reduce technical risk across critical data systems.
  • Own Cost and Efficiency at Scale: Treat cost as a first-class architectural dimension for a multi-petabyte data platform. Lead cost vs. performance tradeoff decisions across storage tiering, compute, file layout, and data movement, and build the visibility and guardrails that let teams reason about unit economics when they design systems.
  • Advance Data and ML Platform Capabilities: Guide the evolution of foundational systems including the identity graph, ML feature platform, feature projection infrastructure, warehouse architecture, and large-scale distributed processing frameworks.
  • Partner on Strategic Priorities: Collaborate with Engineering, Product, Science, and Machine Learning leadership to align platform investments with business objectives, balancing technical debt, platform health, and product velocity.
  • Grow Engineering Talent: Mentor senior engineers and emerging technical leaders. Raise engineering standards through design reviews, architectural guidance, technical artifacts, and thoughtful coaching.

Tech Stack: Java/Python, Spark, Flink, Kafka, Iceberg, ClickHouse, and AWS services (EMR, EKS, S3)

Who You Are
  • Staff-Level Technical Leader. You bring 10+ years of experience building and evolving large-scale distributed systems, data platforms, or backend infrastructure, with a track record of influencing technical direction beyond a single team.
  • Expert in Big Data Systems. You have deep experience designing and operating large-scale data processing platforms using technologies such as Spark, Kafka, Flink, Iceberg, ClickHouse, or similar distributed systems.
  • Architectural Thinker. You have led architectural decisions for complex systems and can balance scalability, performance, reliability, maintainability, and business needs when making technical tradeoffs.
  • Cross-Team Influencer. You have successfully driven complex initiatives across multiple teams and functions, aligning stakeholders around durable technical solutions without direct authority.
  • Cloud-Native Systems Builder. You have extensive experience building and operating data-intensive systems in cloud environments such as AWS, Azure, or GCP.
  • Strategic Problem Solver. You identify systemic technical challenges, proactively create solutions, and drive execution with minimal guidance.
  • Mentor and Multiplier. You elevate the effectiveness of engineers around you through mentorship, technical leadership, and establishing engineering best practices.
  • Exceptional Communicator. You effectively communicate technical strategy, architectural decisions, and tradeoffs to engineering leaders, product stakeholders, and executive audiences.

Bonus Points If You Have
  • Experience designing, scaling, and maintaining petabyte-scale data platforms
  • Expertise in distributed systems architecture and large-scale data processing
  • Experience building ML infrastructure, feature stores, or feature engineering platforms
  • Experience driving platform modernization or data architecture transformations
  • Experience operating in high-growth startup or scale-up environments
  • Deep familiarity with Flink, ClickHouse, Kafka, Iceberg, or similar modern data technologies

What We Offer

At Cognitiv, we believe great work happens when people feel supported, challenged, and empowered to grow. Our Vancouver team receives a competitive total rewards package that includes extended health benefits, paid parental leave, unlimited PTO, Work-From-Anywhere August, equity, RRSP matching, wellness and cell phone stipends, daily team lunches, and a hybrid work environment. We also invest deeply in career development through clear advancement paths and comprehensive onboarding via Cognitiv University - plus additional perks designed to support both your professional and personal wellbeing.

Salary: $170,000 - $240,000 CAD Base Salary + Equity

What We Offer

Compensation is based on experience, skills, and other factors. Base salary is just one part of your total rewards at Cognitiv-you'll also receive equity and a comprehensive benefits package.

Highlights include:

  • Medical, Dental and Vision plan for US employees & Extended Health Benefits for Canadian employees
  • 12 weeks paid parental leave + 4 weeks WFH
  • Unlimited PTO + Work-From-Anywhere August
  • Career development with clear advancement paths
  • Equity for all employees
  • Hybrid work model & daily team lunch
  • Health & wellness stipend + cell phone reimbursement
  • 401(k) & RRSP with employer match
  • Parking (CA, WA, Vancouver offices) & pre-tax commuter benefits
  • Employee Assistance Program
  • Comprehensive onboarding (Cognitiv University)
  • ...and more!

Similar Jobs

More Jobs at Cognitiv

More Information Technology Jobs

Find similar Staff Software Engineer, Big Data jobs: