Position Overview:
The Data Engineer works with the Data Platform team to design, build, and maintain data infrastructure across a diverse set of database technologies including MongoDB, SQL Server, PostgreSQL, MySQL, and Snowflake. This role collaborates with software engineers, data analysts, and architects to ensure our data systems are reliable, secure, and optimized for performance. The Data Engineer is responsible for developing and supporting scalable data solutions.
Job Responsibilities:
- Design, maintain, and manage databases.
- Monitor system health, performance, and availability; identify and escalate issues in a timely manner.
- Support high levels of performance, availability, sustainability, and security across data infrastructure.
- Analyze and resolve database performance issues through query optimization, indexing, and schema improvements.
- Implement appropriate indexes (B-Tree, Geospatial, Text) to improve query performance.
- Assist in designing and maintaining data models and schemas for relational and document-oriented databases.
- Refine and automate recurring operational processes; track issues and maintain documentation.
- Work alongside software developers on query tuning, schema refinement, and REST API data integration.
- Support the planning and implementation of backup, restore, and recovery procedures.
- Contribute to building and maintaining ETL/ELT pipelines using PySpark, AWS Glue, Lambda, and Step Functions.
- Assist in the monitoring of MongoDB Atlas environments including configuration.
- Follow and help enforce best practices for REST API integration frameworks and data access patterns.
- Support database security standards including access control, encryption, and auditing.
Qualificationsand Skills:
- Bachelor's or Master's degree in Software Engineering, Information Technology, Computer Science, or a related field.
- 3+ years of experience in data modelling, schema design, database architecture.
- 3+ years of experience with performance tuning and optimization across relational and NoSQL databases.
- 3+ years of experience managing backups, restores, and recovery models.
- Experience with C# or other object-oriented programming languages.
- Experience with PySpark, AWS Glue, AWS Lambda, and AWS Step Functions.
- Experience working with AWS services, including EC2, S3, RDS, Glue, and Lambda, preferred.
- Experience working with Azure or GCP cloud platforms, preferred.
- Experience with Windows Server, including Active Directory, preferred.
- Experience with automation of database operations, deployments, or related processes, preferred.
- Experience in MongoDB performance troubleshooting and tuning, preferred.
- Commitment to continuous learning and professional development.
- Understanding of MongoDB architecture, replication, and Atlas operations.
- Familiarity with database security management including roles, permissions, and auditing.
- Familiarity with Snowflake concepts including warehousing and basic performance tuning.
- Familiarity with version control tools such as Git/GitHub.
- Familiarity with High Availability (HA) and Disaster Recovery (DR) concepts for SQL Server, preferred.
- Proficiency in SQL query writing across multiple database engines.
- Skilled in taking initiative and managing responsibilities effectively in a dynamic team environment.
- Excellent analytical and problem-solving skills.
- Excellent communication skills.
This job description is intended to convey information essential to understanding the scope of the job and the general nature and level of work performed by job holders within this job. However, this job description is not intended to be an exhaustive list of qualifications, skills, efforts, duties, responsibilities or working conditions associated with the position.