Job Summary
The DevOps Platform Engineer will be part of the Platform team responsible for managing and supporting a Data Science platform. The role will focus on Data Science infrastructure operations, AWS environment development and deployment, CI/CD, Infrastructure as Code, security, vulnerability remediation, database technologies, system upgrades, and ongoing platform maturity. The position will collaborate with Data Science, development, business, Network, Database, Infrastructure, and Architecture teams to support current and future platform needs.
Key Responsibilities
• Support ongoing Data Science infrastructure operations.
• Develop and deploy AWS environments using CI/CD processes for Data Science teams.
• Manage and support large-scale environments to meet the needs of current and future Data Science teams.
• Champion and mature the environment by implementing and overseeing the image management lifecycle process.
• Assist in setting up and managing AWS accounts specifically for the Data Science platform.
• Provide hands-on development using CI/CD tools such as Azure DevOps.
• Utilize Infrastructure as Code (IaC) tools such as Terraform for environment setup and management.
• Develop scripts and applications using programming languages such as Python.
• Manage database technologies including Athena, Oracle, MySQL, and Postgres.
• Leverage AWS services supporting Data Lake, Data Science, and AI/ML teams.
• Handle and resolve requests from development and business users and address technical roadblocks.
• Manage secured infrastructure, enforce security measures, and apply necessary guardrails.
• Resolve infrastructure vulnerabilities within SLAs and maintain audit logs.
• Perform system upgrades and patching and provide on-call support as needed.
• Conduct root cause analysis and knowledge transfer sessions with the internal team.
• Collaborate with Network, Database, Infrastructure, and Architecture teams to align on projects and strategies.
Required Qualifications
• Bachelor's degree in Computer Science or a related field.
• 5+ years of relevant work experience in Data Science Infrastructure.
• Extensive experience with Data Lake, Data Science, and AI/ML services hosted on AWS infrastructure.
• Deep working knowledge of AWS services such as SageMaker, Glue, Lambda, and Athena.
• Hands-on experience with CI/CD tools such as Azure DevOps.
• Hands-on experience with Infrastructure as Code tools such as Terraform.
• Experience with Docker and ECR (Elastic Container Registry).
• Experience with security tools such as AQUA and Kenna.
• Strong communication skills and ability to prepare technical documentation and write-ups.
Preferred Qualifications
• AWS and Terraform certifications.
• Familiarity with technical service management and product lifecycle maintenance.
• Knowledge of programming and scripting languages such as Python and shell scripting.
• In-depth knowledge of database technologies such as Athena, Oracle, and MySQL.
• Extensive experience with CI/CD and IaC tools such as Azure DevOps and Terraform.
