Lead Data Engineer

Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of experience in data engineering or related field
  • Strong skills in SQL or NoSQL databases
  • Extensive experience with Python for ETL workflows
  • Proficient in big data tools like Hadoop or Spark
  • Practical knowledge of cloud services (AWS, GCP, Azure)
  • Experience with infrastructure-as-code tools like Docker or Terraform

Responsibilities

  • Lead and manage data engineering team projects
  • Ensure data quality, security, and integrity
  • Document workflows and operational support
  • Provide technical oversight for application architecture
  • Create scalable code for data manipulation
  • Facilitate communication with stakeholders

Benefits

  • Comprehensive medical, dental, vision, and well-being benefits
  • Competitive 401(k) contribution and pension plan
  • 23 days of paid time off plus 9 paid holidays annually
  • Student loan repayment program available
  • Paid family leave provided
Full Job Description
This position collects, stores, processes and builds applications within our big data platform. Responsible for integrating these applications with the architecture used across the organization.

Position Compensation Range:

$131,000.00 - $220,000.00

Pay Rate Type:

Salary

Compensation may vary based on the job level and your geographic work location. Relocation support is offered for eligible candidates.

This position has approval to transfer a valid H1 visa.

Primary Accountabilities
•Leads an engineering team to meet project deadlines and priorities.
•Supervises assigned data engineering team members & activities.
•Ensures the quality, completeness, security, privacy, and integrity of data throughout the data lifecycle.
•Documents critical workflows and operational support aspects of team’s responsibilities
•Develops deep understanding of data sources, granularity, availability, and limitations.
•Provides proactive technical oversight and advice to application architecture and development teams fostering re-use, design for scale, stability, and operational efficiency of data/analytical solutions.
•Creates maintainable, scalable code to load and manipulate data in the data warehouse.
•Facilitates communication upward and across project teams and business stakeholders.

Specialized Knowledge & Skills Requirements
•Demonstrated experience providing customer-driven solutions, support or service.
•In-depth knowledge of SQL or NoSQL and experience using a variety of data stores (e.g. RDBMS, analytic database, scalable document stores)
•Extensive hands-on Python programming experience, with an emphasis towards building ETL workflows and data-driven solutions. 
•Able to employ design patterns and generalize code to address common use cases.  
•Capable of authoring robust, high quality, reusable code and contributing to the division’s inventory of libraries.
•Expertise in big data batch computing tools (e.g. Hadoop or Spark), with demonstrated experience developing distributed data processing solutions.
•Applied knowledge of cloud computing (AWS, GCP, Azure).
•Knowledge of open source machine learning toolkits, such as sklearn, SparkML, or H2O.
•Solid data understanding and business acumen in the data rich industries like insurance or financial
•Applied knowledge of data modeling principles (e.g. dimensional modeling and star schemas).
•Strong understanding of database internals, such as indexes, binary logging, and transactions.
•Experience using tools for infrastructure-as-code (e.g. Docker, CloudFormation, Terraform, etc.)
•Experience with software engineering tools and workflows (i.e. Jenkins, CI/CD, git).
•Practical experience authoring and consuming web services.

Licenses:
•Not Applicable.

Travel Requirements
•Up to 10%.

Physical Requirements
•Work that primarily involves sitting/standing.

Working Conditions
•Not Applicable.

Additional Information
  • To ensure a strong start, all employees participate in our New Employee Orientation during their first week.  This experience is held in person at our Madison, WI Headquarters or one of our AmFam core locations to help you connect with our mission, meet key team members and build relationships that support your growth.  At times, sessions may be delivered virtually based on scheduling and availability. 
  • Offer to selected candidate will be made contingent on the results of applicable background checks
  • Offer to selected candidate is contingent on signing a non-disclosure agreement for proprietary information, trade secrets, and inventions
  • Sponsorship will not be considered for this position unless specified in the posting


We provide benefits that support your physical, emotional, and financial wellbeing. You will have access to comprehensive medical, dental, vision and wellbeing benefits that enable you to take care of your health. We also offer a competitive 401(k) contribution, a pension plan, an annual incentive, 9 paid holidays and a paid time off program (23 days accrued annually for full-time employees). In addition, our student loan repayment program and paid-family leave are available to support our employees and their families. Interns and contingent workers are not eligible for American Family Insurance Group benefits.

About American Family Mutual Insurance Company

American Family Mutual Insurance Company Careers

There has never been a better time to explore the job opportunities at American Family Mutual Insurance Company, a leading entity in the insurance sector. This company stands out not only for its robust commitment to clients but also for its dedication to fostering a professional growth environment for its employees.

Work You’ll Do

Join American Family Mutual Insurance Company’s esteemed team to assist in pioneering efforts that drive innovation and leadership in the insurance industry. This is where skills meet challenge and excellence. Transform the landscape of insurance with American Family Mutual Insurance Company, where the culture of growth and leadership goes hand in hand with the pursuit of operational excellence. Lead in a unique position in the market, at the nexus of industry knowledge, professional expertise, and digital innovation. Engage with a nationwide team of business and technology advisors to help clients and the company navigate through transformative initiatives. Collaborate with a diverse group of professionals dedicated to upholding the highest standards of service and innovation in the insurance industry.

Introducing the American Family Mutual Insurance Company Professional Pathways

The team is actively building a leading-edge environment to support some of the most well-known companies and clients in mastering their challenges with innovative insurance solutions.

Do Innovative Work

Be part of a team that stands at the forefront of industry expertise and digital transformation, dedicated to delivering targeted solutions through a depth of consulting experience and innovation that is unparalleled.

Drive Innovation and Growth

Work on a wide range of projects that harness the power of teamwork and the latest technologies to deliver impactful results.

Future-proof Your Career

American Family Mutual Insurance Company offers nearly limitless opportunities to advance your career, supported by unmatched training, development programs, and certification support.

Explore

Discover how American Family Mutual Insurance Company is leading the way in predictive analytics to transform the insurance industry. With advanced tools and strategies, the company helps anticipate client needs and industry shifts.

The American Family Mutual Insurance Company Leadership and Development Initiative

This initiative combines service capabilities, global insights, and joint solution development to help clients and employees alike overcome challenges and lead transformation in their fields.

Stay Connected

Join the Team

Search open positions that match your skills and interests. American Family Mutual Insurance Company seeks passionate, curious, creative, and solution-driven team players for various roles from entry-level to leadership positions. SEARCH AMERICAN FAMILY MUTUAL INSURANCE COMPANY JOBS

Keep Up to Date

Stay informed with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the professionals who are part of American Family Mutual Insurance Company.

READ CAREERS BLOG

Job Alert Emails

Customize your subscription to receive job alerts, the latest news, and insider tips tailored to your preferences. Explore what exciting and rewarding opportunities await at American Family Mutual Insurance Company.
Learn more about American Family Mutual Insurance Company

Similar Jobs

More Jobs at American Family Mutual Insurance Company

More Information Technology Jobs

Find similar Lead Data Engineer jobs: