Job Summary
As a Senior Software Engineer in the CDP team, you will drive design, delivery, technical strategy, and execution for critically important data systems. You will define engineering standards, influence long-term platform direction, mentor junior engineers, and ensure the CDP and Foundations platform scales securely and reliably to support sustained business growth.
Key Responsibilities
• Deliver large-scale cloud-native data platforms primarily on AWS, leveraging REST APIs, microservices, and event-driven applications to build highly scalable and resilient systems.
• Work hands-on across the technology stack, including Java, Python, Spark, TypeScript, JavaScript, Angular, AWS services, event-driven architectures, and SQL/NoSQL databases, to solve complex engineering challenges and maintain platform excellence.
• Drive performance optimization, scalability, reliability, security, governance, and cost efficiency.
• Collaborate closely with global engineering, product management, architecture, and business stakeholders to align technical solutions with strategic business objectives.
• Own the end-to-end software development lifecycle, including requirements gathering, solution design, development, deployment, observability, and documentation.
• Define and promote engineering standards, best practices, and technical strategies for scalable data platforms.
• Mentor junior engineers and provide technical guidance to engineering teams.
• Diagnose and resolve complex technical issues across distributed systems, data platforms, and cloud environments.
Required Qualifications
• B.E./B.Tech/M.Tech/MCA in Computer Science, Information Technology, or a related field.
• 5-8 years of strong software engineering experience, with deep expertise in building scalable UX-driven applications and distributed systems architecture.
• Proven experience designing and building scalable REST APIs, microservices, Kubernetes-based solutions, and distributed systems.
• Experience with Data Warehousing, Data Lakes, Delta Lake architecture, and modern big data ecosystem designs.
• Strong hands-on expertise in Python, Java, and Angular.
• Strong understanding of object-oriented design patterns and functional programming.
• Experience with PySpark and Apache Spark, including building high-performance distributed data processing solutions.
• Strong experience with microservices development and Kubernetes containerization for eventing and serving.
• Experience with AWS services such as S3, Lambda, API Gateway, and EventBridge for building scalable and reliable cloud-native data platforms.
• Strong experience with messaging and event-driven technologies such as Kafka, SNS, and SQS.
• Strong expertise in relational and NoSQL databases, including PostgreSQL, SQL Server, Aurora, DynamoDB, MongoDB, and Redis.
• Hands-on experience with Infrastructure as Code (IaC) tools such as Terraform and Ansible.
• Understanding of CI/CD and DevOps practices using tools such as Jenkins, GitHub/GitLab, Bitbucket, GoCD, and automated deployment pipelines.
• Experience implementing robust testing strategies, including unit, integration, and regression testing, while adhering to engineering best practices.
• Strong critical thinking and analytical skills, with the ability to diagnose, troubleshoot, and resolve complex technical problems.
• Awareness of Generative AI technologies, including LLMs, RAG architectures, and Agentic AI systems.
Preferred Qualifications
• Working knowledge of PySpark with Databricks.
• Experience working with Azure and/or Google Cloud Platform (GCP).
• Experience building data platforms in privacy-safe environments or Customer Data Platform and Marketing Technology environments.