Job Description

Remote work opportunity

Responsibilities

About the role:

We are expanding our efforts into complementary data technologies for decision support in areas of ingesting and processing large data sets including data commonly referred to as semi-structured or unstructured data, vehicle telemetry etc. Our interests are in enabling reporting, data science and search based applications on large and low latent data sets in both a batch and streaming context for processing. To that end, this role will engage with team counterparts in exploring and deploying technologies for creating data sets using a combination of batch and streaming transformation processes. These data sets support both off-line and in-line machine learning training and model execution. Other data sets support search engine-based analytics. Exploration and deployment of technologies activities include identifying opportunities that impact business strategy, collaborating on the selection of data solutions software, and contributing to the identification of hardware requirements based on business requirements. Responsibility also includes coding, testing, and documentation of new or modified scalable data engineering and analytic data systems including automation for development, deployment and monitoring. This role participates along with team counterparts to develop solutions in an end-to-end framework on a group of core data technologies.

In this role you will:

• Contribute to the evaluation, research, experimentation efforts with batch and streaming data engineering technologies to keep pace with industry innovation
• Work with data engineering related groups to inform on and showcase capabilities of emerging technologies and to enable the adoption of these new technologies and associated techniques
• Contribute to the definition and refinement of processes and procedures for the data engineering practice
• Work closely with data scientists, data architects, ETL developers, other IT counterparts, and business partners to identify, capture, collect and format data from the external sources, internal systems, and the data warehouse to extract features of interest
• Code, test, deploy, monitor, document and troubleshoot data engineering processing and associated automation

Qualifications

What makes you an ideal candidate?

• Experience with processing large data sets using Hadoop, HDFS, Spark, Kafka, Pulsar, Flume or similar distributed systems.
• Experience with ingesting various source data formats such as JSON, Parquet, CSV, SequenceFile, Cloud Databases, Document Databases like CosmosDB, MQ, Relational Databases such as Oracle.
• Experience with Cloud technologies (such as Azure, AWS, GCP) and native toolsets such as Azure ARM Templates, Hashicorp Terraform, AWS Cloud Formation.
• Understanding of cloud computing technologies, business drivers and emerging computing trends.
• Thorough understanding of Hybrid Cloud Computing: virtualization technologies, Infrastructure as a Service, Platform as a Service and Software as a Service Cloud delivery models and the current competitive landscape.
• Working knowledge of Object Storage technologies to include but not limited to Data Lake Storage Gen2, S3, ADLS etc.
• Working knowledge of Agile development /SAFe, Scrum and Application Lifecycle Management.
• Strong background with source control management systems (GIT or Subversion); Code Quality (Sonar); Artifact Repository Managers (Artifactory), Continuous Integration/ Continuous Deployment (Azure DevOps).
• Experience with NoSQL data stores such as CosmosDB, MongoDB.
• Experience in working with vehicle telemetry and auto insurance data is a plus.
• Creating and maintaining ETL processes.
• Knowledgeable of best practices in information technology governance and privacy compliance.
• Experience with Adobe solutions (ideally Adobe Experience Platform) and REST APIs.
• Troubleshoot complex problems and works across teams to meet commitments.
• Excellent computer skills and proficiency in digital data collection.
• Ability to work in an Agile/Scrum team environment
• Strong interpersonal, verbal, and writing skills.
• Understanding of big data platforms and architectures, data stream processing pipeline/platform, data lake and data lake houses
• SQL experience: querying data and sharing what insights can be derived
• Understanding of cloud solutions such as Microsoft Azure & Amazon AWS cloud architecture & services
• Understanding of GDPR, privacy & security topics. Understanding of data management and governance tools like Atlan, Immuta etc. is a plus.
• Strong in the use of Microsoft Office software, data querying platforms (Databricks is a plus) and statistical programming tools such as Python

Additional Knowledge and Skills

• Working effectively within an AI enabled environment:
  • Ability to use AI tools (e.g., Microsoft Copilot) to support daily work
• Skills in evaluating AI outputs for accuracy, compliance, and bias
• Experience integrating AI into workflows to improve efficiency or insights
• Familiarity with AI assisted research, summarization, and content generation
• Understanding of responsible AI use, including ethics and data protection

Work Experience & Education

• 2-4 years of hands-on experience with data engineering required
• Bachelor's degree in related field or equivalent experience required

What We Offer: Generous benefits package available on day one to include: 401K matching, bonding leave for new parents (12 weeks, 100% paid), tuition assistance, training, GM employee auto discount, community service pay and nine company holidays.

Compensation: Competitive pay and bonus eligibility.

Work Life Balance: Flexible remote work environment.

NOTE:We are unable to consider candidates who require visa sponsorship for this position

This position is not open to agency submissions

#GMFJobs #LI-Remote #LI-SC1

The base range for this role is: $58,000 - $165,500

At GM Financial, we strive for transparency in all aspects of our business, including pay equity. This is the GM Financial pay range for this role and job level. The exact salary and compensation will vary based on factors like knowledge, skills, experience, and education.

This role is eligible to participate in a performance-based incentive plan. Full time employees are eligible to participate in health benefits on day one of employment.