Technical Solution Architect Big Data Lead

Mutual of Omaha   •  

Omaha, NE

Industry: Finance & Insurance


Not Specified years

Posted 39 days ago

The Enterprise Data Lake Platform & Services team is currently seeking a Technical Solution Architect (Technical Lead, Data Engineering), responsible for technical oversight for a team designing, building and implementing enterprise data and analytical solutions, supporting the implementation of Mutual of Omaha's Big Data platform. This is a hands-on position, responsible for both technical leadership and solution development. This team is responsible for the engineering, implementation and enablement of Big Data technologies (Hadoop ecosystem). Team responsibilities include platform engineering, enterprise data engineering and project data engineering services.

This individual will be responsible for technical oversight for a team responsible for platform engineering and delivering both enterprise and project level solutions. Primary areas of focus include providing a stable and secure Data Lake platform, pattern design and build, data ingestion (batch & streaming), data preparation, operationalize pipelines (data & ML), technology/capability enablement, platform/process optimization and tuning, and tool/technology selection and integration (solution stack).

This individual will work closely with a variety of teams (data lake, data science, analytics, data prep & tools) to design, build and deliver data and analytical solutions. Collaboration, partnership and enablement will be key accountabilities.

Essential Job Functions:

  • Provide technical mentoring and coaching to team members.
  • Provide architecture and design oversight for all team activities.
  • Translates the business vision into a technical implementation; provides technical direction to the team.
  • Helps the team to make tradeoffs between functional requirements, non-functional requirements, and constraints.
  • Leads participatory decision making with the team to develop and evolve the design and architecture
  • Ensures quality reviews, and ensures standards are adhered to
  • Communicates with other teams on integration
  • Works to resolve technical impediments
  • Design and build enterprise Data Lake capabilities and patterns (data ingest, resource provisioning, enablement)
  • Partner and collaborate with data science and analytics developers to deliver analytical solutions
  • Design, build and implement data and analytics pipelines
  • Operationalize/productionize data and analytics pipelines
  • Optimize/tune data and analytics/ML processes on the Big Data platform
  • Leverage Big Data platform capabilities to enable analytics/ML model delivery
  • Participate in tool/technology selection and integration (use case solution stack)
  • Ensure data solutions comply with enterprise data governance policies
  • Support team platform responsibilities as assigned
  • Support team on-call responsibilities as assigned
  • Responsible for the design, development and integration of applications and systems that support the business using required tools and languages with an emphasis on maintainability and proper integration of new technology with existing technology.
  • Partners with business and IT representatives in requirements gathering and review.
  • Responsible for analyzing and translating business, information and technical requirements into an architectural blueprint that outlines solutions to achieve business objectives.
  • Works with enterprise architecture, application and infrastructure teams to produce an optimal, high level, conceptual design for the project.
  • Analyzes technical requirements; identifies and evaluates alternatives for technology and integration across applications and system. Develops enterprise level solutions that integrate across applications, systems and platforms.
  • Proposes changes in process, policy and standards as they relate to the architecture and design principles.
  • Researches and maintains knowledge in emerging technologies and solutions to solve business problems.
  • Viewed as a technical expert and critical resource cross multiple disciplines.
  • Leads analysis and design efforts in support of technology integration.
  • Investigates, implements, and transitions new design processes.
  • Develops and pilots new architectures to support application requirements leveraging reusable components. Reviews new applications for conformance to existing architectures. Understands and articulates technology strategies and objectives.
  • Responsible for complying with all Company Information Services policies and standards.
  • Responsible for ensuring appropriate security and privacy measures are implemented on technology solutions to protect
  • Company data from intentional or accidental misuse.
  • This position requires sitting over 66% of the time.
  • This position requires Visual Acuity at 20 inches (or less) over 66% of the time.

Minimum Qualifications:

  • Bachelor's degree in Computer Science, MIS, Math or equivalent
  • Strong experience with Object-oriented/object function programming/scripting using languages such as [R, Python, Java, C++, Scala, others].
  • Strong software engineering acumen
  • Strong team building, mentoring and technical coaching skills.
  • Strong experience with database programming languages including [SQL, PL/SQL, others] for relational databases
  • Strong experience in working with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures and integrated datasets using traditional and/or emerging data integration technologies. These should include [ETL/ELT, data replication/CDC, message-oriented data movement, API design and access].
  • Proficient developing in a Linux environment
  • Proven problem analysis & solving skills
  • Experience with process optimization
  • Self-starter and self-learner. Passion to learn and apply new skills.
  • Effective verbal and written communication skills with the ability to articulate and advocate new ideas and concepts to technical and non-technical audiences.
  • Ability to provide leadership and authority through positive example, delegation, empowerment, coaching, mentoring, and cross-training.
  • Aptitude to formulate and articulate technical vision in order to anticipate and prepare for emerging systems and technology needs with the ability to understand multiple systems or technologies and how they interact.
  • Astuteness in identification and implementation of continuous process improvements.
  • Ability to take accountability and make sound architectural and strategic decisions.
  • Strong teamwork skills to build positive relationships and maintain constructive working relationships, using win-win approaches to resolve conflict.
  • Effective ability to deal with ambiguity, unexpected events, and changing business requirements; ability to juggle multiple activities, projects, and initiatives simultaneously; and ability to handle technical, political, and organizational fluctuations.
  • Ability to take initiative with work activities and to learn/apply new skills.

Preferred Qualifications:

  • Prior experience providing technical oversight for a highly technical team/environment.
  • Experience developing and deploying solutions in the Hadoop technology stack
  • Experience with Dev/Ops & continuous integration
  • Experience with micro-service and/or distributed architectures
  • Experience with distributed systems & parallel data processing
  • Experience or knowledge of Enterprise Data Warehousing
  • Experience with HDFS, Hive, Spark
  • Experience with On-Prem, Hybrid, Cloud environments
  • Experience with NoSQL platforms
  • Experience with search technologies: ELK or Solr
  • Experience with messaging systems (Kafka, MQ)
  • Experience with analytical systems development (collaboration with data science resources)