We are currently seeking a Data Engineer to join our team in. The Data Engineer role is responsible for building and maintaining the data infrastructure that empowers our organization to make data-driven decisions. You will be responsible for designing, developing, and deploying data pipelines to ensure the smooth flow of clean, consistent, and high-quality data to our data scientists, analysts, and other stakeholders. documentation.
A successful candidate will have:- A strategic mindset and track record of making sense of complex and sometimes conflicting information
- Strong communication skills, across various modes and audiences
- An attitude and aptitude for continuous improvement
- Ability to effectively build and maintain relationships with Emprise associates, vendors, and professional contacts
- An understanding of and commitment to our values
Essential functions of the role:- Design, develop, and maintain data pipelines for efficient and reliable data ingestion from various sources, including APIs, databases, and files
- Utilize cloud technologies, primarily in Azure, for data storage, processing, and orchestration
- Document data pipelines and processes for clear understanding and maintainability
- Design and implement overarching pipeline architecture to enable Data & AI team to have traceable data lineage and clear purpose of data assets
- Monitor and maintain data pipelines for optimal performance and troubleshoot any issues that arise
- Implement robust data quality checks and transformation processes to ensure data accuracy and consistency
- Follow data governance standards in documentation, ensuring compliance with regulatory requirements and internal policies
- Collaborate with data analysts, data analytics engineers, and data scientists to understand their data needs and provide technical assistance
- Stay up to date with emerging technologies and best practices in the data engineering field
Other duties as assigned within the scope of the role
Requirements- Bachelor's degree in computer science, mathematics, or a related technical field
- Master's degree in technical field preferred
- Proficient in SQL and scripting languages (e.g., Python, Java)
- Experience in Azure Cloud is preferred
- Experience with Azure Data Factory and Databricks is a plus
- Excellent communication and collaboration skills
- Ability to work independently and as part of a team
- Strong problem-solving and analytical skills
- A passion for learning and staying up-to-date with the latest advancements in data engineering
BenefitsIn addition to a competitive salary and benefits, Emprise offers professional growth, a rewarding and challenging environment, opportunities to be involved in our communities, and a culture of integrity, passion, and success.
