Job Summary:
The Data Engineer - MarTech will join the Marketing Technology (MarTech) team, supporting Retail Media Network (RMN), CRM, Campaign Management, Personalization, and Digital Marketing initiatives. The candidate will be responsible for designing, developing, and maintaining scalable batch and real-time data pipelines using Databricks, Apache Spark, SQL, and Python/Scala. The role focuses on improving data quality, freshness, governance, customer identity resolution, and data accessibility across marketing platforms. The candidate will also build governed semantic layers and AI-ready data foundations to support AI agents, LLM-powered applications, and advanced marketing analytics.
Key Responsibilities:
• Design, develop, and maintain scalable batch and real-time data pipelines using Databricks, Apache Spark, and related technologies.
• Build and maintain data models, customer attributes, feature pipelines, and marketing data feeds.
• Develop and maintain governed semantic layers using Delta Lake, Unity Catalog, dbt, or similar technologies.
• Prepare structured, AI-ready datasets, schemas, metadata, and documentation for LLM applications and AI agents.
• Implement data quality checks, monitoring, validation, and change management processes.
• Integrate customer data and audiences with marketing activation platforms such as Hightouch and Salesforce Marketing Cloud (SFMC).
• Work with Data Science teams to productionize machine learning features and collaborate with architects on data contracts and identity resolution.
• Support real-time data processing and event-driven architectures using technologies such as Kafka.
• Ensure data privacy, security, governance, and regulatory compliance, particularly when handling Personally Identifiable Information (PII).
• Build data retrieval and query interfaces to support AI-powered applications, including Text-to-SQL, Retrieval-Augmented Generation (RAG), and tool-calling.
• Prepare technical roadmaps, project status reports, performance metrics, and leadership-level decision documents.
Required Qualifications:
• 3+ years of professional experience in Data Engineering.
• Strong proficiency in SQL and programming languages such as Python or Scala.
• Hands-on experience with Databricks, Apache Spark, and Delta Lake.
• Experience designing and developing scalable ETL/ELT data pipelines.
• Strong understanding of data lakehouse, data warehouse architecture, and pipeline orchestration.
• Experience with real-time data processing, streaming technologies, and event-driven architectures such as Apache Kafka.
• Hands-on experience building semantic layers or metrics layers using Unity Catalog Metric Views, dbt/MetricFlow, or similar tools.
• Experience preparing and modeling data for AI agents, LLM applications, Text-to-SQL, retrieval systems, or tool-calling.
• Knowledge of data modeling, data governance, data quality, and change management.
• Understanding of customer and marketing data concepts such as Customer 360 (C360), RFM, Customer Lifetime Value (LTV), and loyalty data.
• Understanding of data privacy, PII protection, and compliant customer data management.
Preferred Qualifications:
• Experience working in MarTech, Digital Marketing, CRM, Personalization, or Retail Media Network environments.
• Experience with Salesforce Marketing Cloud (SFMC), Hightouch, LiveRamp, or UID2.
• Familiarity with Databricks Genie, Agent Bricks, Model Context Protocol (MCP), Vector Search, and LLM evaluation.
• Experience integrating marketing data with Content Management Systems (CMS) and Digital Asset Management (DAM) platforms such as Contentstack.
• Experience with reverse ETL, audience activation, and customer identity resolution.
• Previous experience in retail, convenience retail, or e-commerce industries.
• Understanding of agentic AI architecture and securely exposing governed enterprise data to AI agents.