Roles and ResponsibilitiesAs a Data Engineer, the primary responsibility is to design, construct, and maintain scalable data pipelines and architectures to facilitate the collection, storage, and processing of large datasets.
This role involves working closely with data scientists and analysts to provide accessible and reliable data for analytics and reporting.
Data Engineers are tasked with integrating and transforming data from various sources, ensuring data quality, and optimizing database performance.
Additionally, they must stay current with industry trends and technologies to continuously improve data processes and systems.
Collaboration with cross-functional teams to understand data needs and implement data governance strategies is also a crucial aspect of the role.
Experience/Qualifications:- Undergraduate college degree from an accredited college or university in computer science, statistics, mathematics, or other discipline related to the requirements of this project, or equivalent experience.
- At least 4 years of experience in data engineering, ETL (Extract, Transform, Load) processes, and data warehousing solutions.
- Strong proficiency in programming languages such as Python, Java, or Scala, as well as SQL for querying databases.
- Familiarity with technologies (e.g., AWS, Azure, Google Cloud).
- Experience with databases (e.g., Oracle, SQL Server, PostgreSQL, MySQL, NoSQL databases) and data modeling techniques.
- Knowledge of data privacy and security standards, along with experience in data governance practices.
Ability to work collaboratively in a fast-paced team environment and communicate effectively with technical and non-technical stakeholders
