Job DescriptionThis position is full time, remote.
Role Responsibilities:- The Senior Data Engineer is critical in shaping the strategic data framework of the organization. This role demands a deep understanding of data systems and analytics, tasked with leading the development and integration of extensive business intelligence solutions. The Senior Data Engineer drives the design and maintenance of scalable data environments, ensures data integrity, and supports decision-making processes across the company with high-quality data insights. A Data Engineer Senior is responsible for designing, testing, and maintaining data management systems, developing complex data models, ensuring data integrity, participating in strategic planning, and supporting BI and analytics teams.
- Design, construct, test, and maintain highly scalable data management systems.
- Develop and optimize ETL processes, ensuring efficient data integration and transformation.
- Implement data solutions that support significant, dynamic business requirements, collaborating closely with business intelligence and analytics teams.
- Review, analyze, and modify systems including encoding, testing, debugging, and documenting programs.
- Maintain and develop logical and physical data models, data management standards and conventions, and data naming standards and metadata.
- Perform reverse engineering of physical data models from databases and SQL scripts.
- Evaluate data models and physical databases for variances and discrepancies.
- Ensure data objects and architecture support company-wide technology solutions, making adjustments as necessary.
- Mentor junior engineers, sharing knowledge and best practices, and guiding them in their professional development.
Candidate QualificationsPreferred:
- At least 1 year experience in Databricks
Required:
- Bachelor's Degree in Computer Science, Engineering, or related field A Master's degree is preferred.
- At least 5 years of relevant experience in a data engineering role, with a proven track record in sophisticated BI and data warehouse development projects.
- Expert knowledge of SQL and experience with big data technologies such as Spark, Databricks, and modern data warehousing solutions like BigQuery, Snowflake or Redshift.
- Strong familiarity with cloud platforms, such as AWS, Azure, or Google Cloud.
- Experience with data integration tools (e.g., Apache Airflow, Talend) and understanding of data modeling principles.
- Excellent problem-solving abilities, capable of tackling complex data challenges.
- Strong communication skills and the ability to work collaboratively across team and department boundaries.
- Healthcare industry experience preferred.
- Fundamental understanding of the Information Management principles, IT processes, SDLC, architecture and technologies adopted by an organization.
- Requires experience with SharePoint, and Office 365 products.
- Experience working in an Agile environment with Azure DevOps is a plus.
