Job Summary:
We are seeking a Lead Java Developer to drive design, delivery, technical strategy, and execution for critically important cloud-native data systems. The role will focus on building scalable and resilient platforms using Java, Python, AWS, REST APIs, microservices, event-driven architectures, distributed systems, and modern data technologies. The successful candidate will own the end-to-end software development lifecycle, influence platform direction, establish engineering standards, mentor engineers, and ensure platform scalability, security, reliability, and cost efficiency.
Key Responsibilities:
• Deliver large-scale cloud-native data platforms primarily on AWS using REST APIs, microservices, and event-driven applications.
• Work hands-on across the technology stack, including Java, Python, Spark, TypeScript, JavaScript, Angular, AWS services, event-driven architectures, and SQL/NoSQL databases.
• Lead product-wide technical initiatives focused on performance optimization, scalability, reliability, security, governance, and cost efficiency.
• Partner with global engineering, product management, architecture, and business stakeholders to align technical solutions with strategic business objectives.
• Own the end-to-end software development lifecycle, including requirements gathering, solution design, development, deployment, observability, and documentation.
• Design and build scalable REST APIs, microservices, Kubernetes-based solutions, and distributed systems.
• Develop and support data warehousing, data lake, Delta Lake, and modern big data ecosystem solutions.
• Develop high-performance distributed data processing solutions using Apache Spark and PySpark.
• Implement Kubernetes-based microservices and containerized solutions for eventing and serving.
• Utilize AWS services such as S3, Lambda, API Gateway, and EventBridge to build scalable and reliable cloud-native platforms.
• Implement messaging and event-driven solutions using Kafka, SNS, and SQS.
• Implement Infrastructure as Code using Terraform and Ansible.
• Establish and maintain CI/CD and DevOps practices using Jenkins, GitHub/GitLab, Bitbucket, GoCD, and automated deployment pipelines.
• Implement robust testing strategies, including unit, integration, and regression testing.
• Diagnose, troubleshoot, and resolve complex technical problems.
• Mentor and guide junior engineers while fostering technical excellence, collaboration, innovation, and accountability.
Required Qualifications:
• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field, or MCA.
• 8-10 years of strong software engineering experience with expertise in scalable applications and distributed systems architecture.
• Strong hands-on expertise in Java, Python, and Angular.
• Strong understanding of object-oriented design patterns and functional programming.
• Proven experience designing and building scalable REST APIs, microservices, Kubernetes solutions, and distributed systems.
• Expertise in Apache Spark and PySpark, with experience building high-performance distributed data processing solutions.
• Experience with data warehousing, data lakes, Delta Lake architecture, and modern big data ecosystem designs.
• Strong experience with Kubernetes containerization for eventing and serving.
• Extensive experience with AWS services including S3, Lambda, API Gateway, and EventBridge.
• Strong experience with Kafka, SNS, and SQS and relational and NoSQL databases including PostgreSQL, SQL Server, Aurora, DynamoDB, MongoDB, and Redis.
• Hands-on experience with Infrastructure as Code tools such as Terraform and Ansible.
• Strong understanding of CI/CD and DevOps practices using tools such as Jenkins, GitHub/GitLab, Bitbucket, and GoCD.
• Experience implementing unit, integration, and regression testing strategies.
• Strong critical thinking, analytical, troubleshooting, and problem-solving skills.
• Exposure to Generative AI technologies, including LLMs, RAG architectures, and Agentic AI systems.
Preferred Qualifications:
• Working knowledge of PySpark with Databricks.
• Experience working with Azure and/or Google Cloud Platform (GCP).
• Experience building data platforms in privacy-safe environments or Customer Data Platforms and Marketing Technology environments.