Walmart is seeking a
Principal Data Engineer to lead the design and evolution of large-scale data pipeline infrastructure, delivering scalable, cloud-native data solutions that power search and personalization across Walmart's e-commerce platform. This role owns the full data engineering lifecycle - from ingestion and transformation to feature/dataset delivery - ensuring high availability, data quality, and fault tolerance at scale. The position requires strategic technical leadership, mentorship, and cross-functional collaboration to align data engineering efforts with business and ML objectives. The successful candidate will champion innovation, set data architecture standards, and drive continuous improvement while upholding Walmart's commitment to integrity and operational excellence.
About the team: The team owns the data pipeline framework supporting Search and Personalization at Walmart. They build and maintain systems that ingest user interaction signals, catalog data, and other key sources, transforming them into high-quality features and datasets. These datasets power the machine learning models that drive search relevance and personalized shopping experiences at scale. The team builds robust, scalable solutions using modern data engineering and cloud-native architecture, with collaboration and technical excellence central to delivering impactful results.
**Immigration Sponsorship support will NOT be available for thisposition**What you'll do: - Lead the architecture and delivery of scalable, cloud-native data pipelines and reusable data infrastructure aligned to strategic roadmaps.
- Own the end-to-end data engineering lifecycle: ingestion, transformation, orchestration, testing, deployment, and monitoring of large-scale distributed data systems.
- Design and build high-throughput, low-latency pipelines (batch and streaming) that produce ML-ready features and datasets for search and personalization models.
- Provide technical leadership and mentorship across data engineering teams, promoting best practices in data modeling, pipeline design, and architectural consistency.
- Partner with ML, search, and product stakeholders to translate business and model requirements into scalable data solutions and measurable success metrics.
- Ensure data quality, lineage, and reliability through observability, validation frameworks, and SLA ownership across pipelines.
- Drive continuous improvement through innovation, knowledge sharing, and adoption of emerging data engineering technologies.
What you'll bring: - Extensive experience leading large-scale data engineering initiatives, including distributed data processing, data modeling, and cloud-native data platforms.
- Proven expertise with big data technologies (e.g., Spark, Kafka, Hadoop) and data pipeline orchestration tools (e.g., Airflow).
- Strong programming skills in Python, Java, or Scala, with experience building production-grade ETL/ELT and streaming pipelines.
- Deep understanding of data warehousing, feature engineering, and data infrastructure supporting ML/AI systems.
- Experience with cloud platforms (Azure, GCP, or AWS) and CI/CD practices for data systems.
- Demonstrated ability to mentor engineers and influence data architecture decisions across teams.
- Excellent collaboration and communication skills with cross-functional and ML stakeholders.
- Commitment to data quality, continuous improvement, and engineering excellence.
Flexible, hybrid work
We use a hybrid way of working with primary in office presence coupled with an optimal mix of virtual presence. We use our campuses to collaborate and be together in person, as business needs require and for
development and networking opportunities. This approach helps us make quicker decisions, remove location barriers across our global team, be more flexible in our personal lives.
Benefits:Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include a host of best-in-class benefits maternity and parental leave, PTO, health benefits, and much more.
The annual salary range for this position is $143,000.00 - $286,000.00
Additional compensation includes annual or quarterly performance bonuses.
Additional compensation for certain positions may also include :
- Stock