EMC Insurance

Data Engineer III

EMC Insurance$92K — $140K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in a computer-related field or equivalent experience
  • 5+ years in data integration development or related fields
  • Strong SQL skills with relational databases
  • Proficiency in Python and applicable programming languages
  • Experience with cloud services such as RDS, S3, and Lambda
  • Knowledge of ETL/ELT tools like DBT/Informatica
  • Effective communication skills and attention to detail

Responsibilities

  • Investigate and analyze feasibility of data integration prototypes
  • Develop specifications for data integration components
  • Maintain complex automated ETL/ELT pipeline architecture
  • Monitor, troubleshoot, and optimize data pipelines
  • Guide business customers in developing SQL and ETL/ELT solutions
  • Lead cross-functional collaboration to define data requirements
  • Develop complex data objects and models for business analytics

Benefits

  • Comprehensive rewards package offering various benefits
  • Opportunities for professional development and growth
  • Collaborative and innovative work environment
  • Focus on data governance, security, and privacy
  • Support for remote or hybrid work arrangements
Full Job Description


Essential Functions:

Develops, tests, and maintains complex prioritized engineering (design/build/test) work as a member of a data analytics product pipeline architecture and infrastructure team:
  • Investigates and analyzes feasibility of data integration prototypes and program requirements
  • Develops specifications and plans the full range of programming actions to produce data integration components
  • Develops and maintains complex automated ETL/ELT pipeline architecture that cleans, transforms, and aggregates data from disparate sources using architecturally approved tools, programming languages, and services to deliver a data mesh approach
  • Develops and maintains complex automated ETL/ELT monitoring and alarming solutions using architecturally approved languages and services
  • Monitors, troubleshoots, and optimizes data pipelines for quality, performance, and reliability creating a single source of truth providing business customers with highly reliable and quality data
  • Builds complex unit tests to enable test driven development and automation to drive code reliability
  • Develops, maintains, tests, and deploys code with architecturally approved toolsets using Dev Ops practices, ETL/ELT pipelines, data catalogs and data queries
  • Maintains data solutions in a divest state to ensure business functionality until replaced with new technology
  • Balances and designs data analytics product solutions based on cost and performance to meet data needs and business requirements
  • Guides business customers to develop, troubleshoot, and optimize complex SQL and ETL/ELT solutions to solve reporting, metrics, and analytics problems


Data analysis: Collaborates with cross-functional teams to understand data requirements for data analytics products and translate them into scalable and efficient data solutions:
  • Leads moderately complex projects or supports larger initiatives as part of a team
  • Partners with users and stakeholders to understand data needs and business requirements
  • Leads the team on conceptualizing and developing new data solutions to meet the business data needs and requirements
  • Researches, performs analysis, and proposes effective solutions related to system developments and enhancements through collaboration with Data Architecture
  • Analyzes and reviews potential adjustments or modifications for impacts on other programs
  • Leverages data governance, data security, and privacy principles to support data lineage and reference data needs
  • Collaborates with cross-functional teams to understand business and downstream application (BI reporting, Data Science, Data Governance, other System integrations) and consumer requirements to deliver data-driven solutions that implement best practices for data management, security, and governance


Data modeling:
  • Develops complex data objects for business analytics using data modeling techniques
  • Models front-end and back-end data sources to help draw a more comprehensive picture of user flows throughout the system and to enable powerful data analysis
  • Works with stakeholders to understand complex business needs and translates them into a conceptual data model, defining entities, attributes, and relationships
  • Builds complex detailed logical models based on the conceptual model, specifying data types, constraints, and keys to ensure data integrity
  • Implements complex logical models into appropriate database management systems, considering database features, storage optimization, and performance considerations
  • Designs complex data pipelines to extract data from source systems, transform it as needed based on the data model, and load it into the target database


Documentation:
  • Participates in creating and maintaining documentation related to the design of applications and interfaces to enterprise and third-party systems in accordance with departmental and team standards
  • Collaborates with data governance on ensuring what is being produced in data analytics products enables data governance to publish a data asset
  • Collaborates with data governance to develop and maintain data analytic products, artifacts and user documentation for business customers
  • Works with business customers and software development teams to gather and document requirements for data publishing and data consumption via data mesh architecture
  • Maintains systems documentation


Education & Experience:
  • Bachelor's degree, preferably in a computer related field or equivalent relevant experience
  • Five years of data integration development experience, or related experience


Knowledge, Skills & Abilities:
  • Strong SQL knowledge and experience working with relational databases
  • Excellent analytical skills to work with unstructured datasets
  • Excellent knowledge of applicable programming languages, such as Python
  • Strong knowledge of cloud services such as RDS, S3, SNS, CloudWatch and Lambda
  • Strong knowledge of DBT/Informatica or other ETL/ELT tools preferred
  • Strong knowledge of Snowflake
  • Strong knowledge of data modeling
  • Excellent ability to build processes supporting data transformation, data structures, metadata, dependency and workload management
  • Strong ability to manipulate, process and extract value from large, disconnected datasets
  • Strong knowledge of DevOps and/or DataOps practices, CI/CD pipelines, and containerization technologies preferred
  • Excellent knowledge of orchestration or scheduling tools
  • Excellent verbal and written communication skills
  • Strong attention to detail, organizational and multi-tasking skills with the ability to adapt to changing priorities
  • Ability to maintain confidentiality


The hiring salary range for this position will vary based on geographic location, falling within either of the following:
$92,670 - $128,045 or $102,443 - $140,845
A hiring range represents a subset of the full salary range. The actual salary will depend on several factors, including relevant education, skills, and experience of an applicant, geographic location, and business needs.

For information relating to the benefits EMC Team Members receive as part of a comprehensive rewards package, please visit www.emcins.com/careers

About EMC Insurance

EMC Insurance Group Inc. is an insurance holding company based in Des Moines, Iowa. The company provides property and casualty insurance products and services to businesses and individuals in the United States. The company operates through two segments: Property and Casualty Insurance and Reinsurance. The Property and Casualty Insurance segment provides commercial and personal lines of insurance products. The Reinsurance segment provides reinsurance for other insurers. The company was founded in 1911 and is publicly traded on the NASDAQ under the ticker symbol EMCI.
Learn more about EMC Insurance
Industry
Founded
1911
NASDAQ

Similar Jobs

More Jobs at EMC Insurance

More Information Technology Jobs

Find similar Data Engineer III jobs: