Job Summary

We are seeking a Senior Software Engineer with 8-10 years of strong software engineering experience and deep expertise in scalable cloud-native applications, distributed systems, and modern data platforms. The role will focus on designing, developing, and delivering highly scalable and resilient data platforms primarily on AWS, leveraging Java, Python, Apache Spark, PySpark, Kubernetes, microservices, REST APIs, event-driven architectures, and modern data lake technologies. The ideal candidate will work across the full software development lifecycle, drive technical initiatives, collaborate with global stakeholders, and contribute to performance, scalability, reliability, security, governance, and cost optimization.

Key Responsibilities
• Design and deliver large-scale cloud-native data platforms primarily on AWS using REST APIs, microservices, and event-driven architectures.
• Work hands-on across Java, Python, Spark, TypeScript, JavaScript, Angular, AWS services, SQL/NoSQL databases, and distributed systems.
• Build scalable and resilient REST APIs, microservices, and distributed applications.
• Design and implement high-performance distributed data processing solutions using Apache Spark and PySpark.
• Lead technical initiatives focused on performance optimization, scalability, reliability, security, governance, and cost efficiency.
• Partner with engineering, product management, architecture, and business stakeholders to align technical solutions with strategic objectives.
• Own the end-to-end software development lifecycle, including requirements gathering, solution design, development, deployment, observability, and documentation.
• Develop and maintain data platforms leveraging Data Warehousing, Data Lakes, and Delta Lake architectures.
• Implement event-driven applications and messaging solutions using Kafka, SNS, and SQS.
• Design and maintain containerized microservices using Kubernetes.
• Implement Infrastructure as Code using Terraform and Ansible.
• Develop and maintain CI/CD pipelines and automated deployment processes.
• Implement robust unit, integration, and regression testing strategies.
• Troubleshoot and resolve complex technical issues using strong analytical and critical-thinking skills.
• Mentor and guide junior engineers while promoting technical excellence, collaboration, accountability, and innovation.

Required Qualifications
• B.E., B.Tech, M.Tech, MCA, or equivalent degree in Computer Science, Information Technology, or a related field.
• 8-10 years of strong software engineering experience.
• Deep expertise in building scalable applications and distributed systems architectures.
• Proven experience designing and developing scalable REST APIs and microservices.
• Strong hands-on expertise in Java, Python, and Angular.
• Strong understanding of object-oriented design patterns and functional programming.
• Expert-level experience with Apache Spark and PySpark for distributed data processing.
• Strong experience with Kubernetes and containerized microservices.
• Experience with Data Warehousing, Data Lakes, Delta Lake architecture, and modern big data ecosystems.
• Extensive experience with AWS services including S3, Lambda, API Gateway, and EventBridge.
• Strong experience with event-driven and messaging technologies including Kafka, SNS, and SQS.
• Strong experience with relational and NoSQL databases including PostgreSQL, SQL Server, Aurora, DynamoDB, MongoDB, and Redis.
• Hands-on experience with Infrastructure as Code tools such as Terraform and Ansible.
• Strong understanding of CI/CD and DevOps practices using Jenkins, GitHub/GitLab, Bitbucket, GoCD, or similar tools.
• Experience implementing unit, integration, and regression testing strategies.
• Strong critical-thinking, analytical, troubleshooting, and problem-solving skills.
• Exposure to Generative AI technologies, including LLMs, RAG architectures, and Agentic AI systems.

Preferred Qualifications
• Working knowledge of PySpark with Databricks.
• Experience with Azure and/or Google Cloud Platform (GCP).
• Experience building privacy-safe data platforms, Customer Data Platforms (CDPs), or Marketing Technology solutions.
• Experience with modern cloud-native data platforms and distributed systems at enterprise scale.