Big Data Engineer

State Farm Insurance   •  

Bloomington, IL

Industry: Accounting, Finance & Insurance


Not Specified years

Posted 38 days ago

We put emphasis on providing business outcomes, not just outputs. We provide data, data processing, and analytic capabilities that support back office operations, regulatory and compliance reporting, operational insights, and downstream advanced analytics. This big data engineer will modernize our mainframe bank data repository into a trusted, consumable, and centralized bank data repository with big data technology.

Core Skills and Experience:
Aptitude to learn and apply new skills, technology, and innovative ideas
Experience developing in multiple programming languages and technologies
Experience with data design, modeling, architecture, and governance
Experience with relational, NoSQL, and distributed data platforms
Experience with data curation and integration using ETL tools
Data pipelines and data processing using distributed processing or parallel computing languages
Understanding of data warehousing and business intelligence concepts
Ability to connect and communicate business needs to technical solutions and back to business value
Exceptional communication and presentation skills (written and verbal)
Demonstrated analytical, quantitative, and problem solving skills
Must be comfortable being on-call for off-hours support

Icing on the Cake:
Previous experience creating data warehouses, data lakes, a business intelligence solutions
Hands on design and development, with previous experience creating enterprise grade data solutions in Hadoop, Cloud, or other big data platforms
Experience with multi-tenant clusters and workload management
Data modeling and design of time sequence, journal, data structures
Stream processing, and low latency data pipelines with large scale big data technologies
Experience with free form text, search based, applications
Experience in public cloud technologies such as AWS, Google Cloud, or Azure (etc.)

Duties and Responsibilities:

  • Possesses an understanding of how technology solutions meet the business outcomes and offers a range of solutions for business partners; understand business current and aspirational needs
  • Participates in sprint planning; provides work estimates to deliver product stories; owns development stories
  • Develops solutions on variety of platforms according to business requirements
  • Completes required coding to satisfy the defined acceptance criteria and deliver desired outcome
  • Leads solution design, considering risks, mitigations, performance, user experience, and testability
  • Assists in development of automated testing and supporting code as necessary
  • Completes required documentation to communicate information to deployment, maintenance, and business teams
  • Utilizes agile software development practices, data and testing standards, code reviews, source code management, continuous delivery, and software architecture
  • Participates in the full software development cycle including coding, testing, implementation, support and sunset
  • Designs, develops, tests and supports software in support of big data objectives
  • Possesses an understanding of User Experience practices to improve usability and interaction between the customer and product
  • Adopts Service Design, where appropriate, through architecture modularity to enable continuous delivery
  • Considers applying emerging technology solutions to increase efficiency and effectiveness; expectation of continuous innovation
  • Resolves problems that result in a decreased time to market; improves quality, enhances flexibility, and embraces the solution provider mindset
  • Provides input into overall testing plan; contributes to test approach and scenarios for requirements
  • Provides product and/or process expertise necessary to support design, development, testing and execution of solutions
  • Exhibits DevOps mindset where team is accountable for product from inception to sunset