Data Engineer (AWS)Application Deadline: 8 August 2025
Department: Product
Employment Type: Full Time
Location: Remote
Reporting To: VP, Business Intelligence
DescriptionWe're seeking a skilled AWS Data Engineer to architect and maintain our core data infrastructure on AWS. You'll design and implement scalable ETL pipelines using AWS Glue and EMR, optimize our Amazon Redshift data warehouse, and build real-time data processing systems using Kinesis and Lambda. Working with infrastructure as code using Terraform, you'll manage database migrations with AWS DMS and orchestrate complex workflows using Step Functions. Collaborating with our Business Intelligence team, you'll transform complex data systems into reliable, automated solutions that power analytics for our fintech and gaming platform. The ideal candidate brings 2+ years of hands-on data engineering experience focused on AWS, deep expertise in Terraform, and proven experience with AWS data services including DMS, Glue, Redshift, and Kinesis.
Key Responsibilities- Configure and maintain infrastructure as code using Terraform, AWS CloudFormation, or CDK
- Build and maintain data warehouse architecture in Amazon Redshift and data lake solutions in Amazon S3
- Execute database migrations and real-time replication using AWS Database Migration Service (DMS)
- Design and implement scalable data pipelines using AWS Glue, AWS EMR, and AWS Lambda
- Develop ETL/ELT workflows using AWS Glue Studio and custom PySpark jobs
- Implement real-time data streaming solutions using Amazon Kinesis and Kinesis Analytics
- Create and optimize data models using Amazon Redshift Spectrum and Athena
- Orchestrate complex workflows using AWS Step Functions and Amazon EventBridge
- Design and manage continuous data replication strategies using DMS for heterogeneous databases
- Implement data governance using AWS Lake Formation and AWS Glue Data Catalog
- Monitor and optimize data pipeline performance using Amazon CloudWatch and AWS X-Ray
- Design and implement data security using AWS IAM, KMS, and VPC configurations
- Collaborate with analysts to provide self-service analytics through AWS QuickSight
- Lead AWS Well-Architected reviews for data platform components
Skills, Knowledge and Expertise- 2+ years of experience in data engineering focused on AWS
- AWS Certified Data Analytics or AWS Certified Solutions Architect (preferred)
- Expert-level SQL and Python programming with PySpark experience
- Deep expertise with AWS data services: Glue, Redshift, S3, Athena, EMR
- Strong experience with Terraform for AWS infrastructure automation:
- Writing and maintaining Terraform modules
- Managing Terraform state and workspaces
- Implementing CI/CD pipelines for Terraform deployments
- Experience with Terraform best practices and patterns
- Hands-on experience with AWS Database Migration Service (DMS) for:
- Homogeneous and heterogeneous database migrations
- Continuous data replication and CDC (Change Data Capture)
- Migration assessment and schema conversion using AWS SCT
- Extensive experience with Amazon Kinesis for real-time data processing
- Strong knowledge of AWS Lambda and serverless architectures
- Proven experience with infrastructure as code (Terraform preferred, CloudFormation/CDK acceptable)
- Experience with AWS Step Functions and EventBridge for workflow orchestration
- Expertise in data lake architectures using S3, Lake Formation, and Glue Catalog
- Strong understanding of AWS security best practices (IAM, KMS, VPC)
- Knowledge of Apache Airflow on AWS (MWAA) or similar orchestration tools
- Experience with monitoring tools (CloudWatch, X-Ray, AWS Cost Explorer) and use of APM tools such as Datadog, New Relic, AppDynamics
Bonus/Wishlist- HashiCorp Certified: Terraform Associate certification
- Experience with Terragrunt for managing Terraform configurations
- Experience with Amazon SageMaker for ML pipelines
- Knowledge of AWS MSK (Managed Kafka) or Amazon MQ
- Familiarity with AWS AppFlow for SaaS integrations
- Experience migrating from legacy databases to AWS using DMS
- Knowledge of API development on AWS
- Previous fintech or adtech industry experience
