Specialist - Data Engineering

LTM

$110K — $130K *
Tampa, FL 33647In-Person
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience with Ab Initio GDE and graph development.
  • Strong SQL and Unix shell scripting skills.
  • Basic knowledge of Big Data and Hadoop ecosystem.
  • Proven expertise in ETL design and delivery using Ab Initio.
  • Familiar with metadata management in EME.

Responsibilities

  • Lead the design and development of Ab Initio graphs.
  • Conduct thorough code reviews to enforce standards and best practices.
  • Investigate performance issues and recommend optimization strategies.
  • Prepare necessary test datasets for comprehensive testing.
  • Collaborate with operations to ensure effective scheduling and recovery procedures.

Benefits

  • Opportunity to work in a leadership role within a collaborative team environment.
  • Exposure to cutting-edge technologies in data processing and ETL tools.
  • Support for professional growth and mentoring opportunities within the team.
Full Job Description
Role description

Job Title: Sr. Abinitio Developer

Work Location

Tampa FL

Job Description:

  • Hands on technical lead for a Ab Initio delivery team design graphs enforce standards mentor devs own performance and production readiness for assigned modules
  • Do deep code reviews of GDE graphs naming parameterization component reuse error handling and logging
  • Lead performance investigations identify skew repartition points costly sorts and recommend rewrite partitioning improvements
  • Prepare test datasets and scripts for unit regression performance testing
  • Work with Ops to ensure Cooperating scheduling appropriate restart strategies and runbook snippets for each graph
  • Working Basic knowledge in Bigdata Hadoop Eco system
  • Experience and expertise on SQL and Unix shell scripting Knowledge on Abinitio air commands and m commands

Must have technical skills
  • Expert with GDE graph authoring and debugging comfortable editing cfg parameter files and using graph debugger slogs
  • Strong knowledge of Ab Initio operators Join Reformat Dedup Rollup Aggregate Rank Sort Partition Merge Lookup and when to use each optimally in a parallel environment
  • Mastery of partitioning strategies and the impact on network IO memory and merge sort costs
  • Familiarity with EME for metadata component check ins and versioning
  • Ability to write auxiliary shell scripts and SQL for test data and postprocessing
  • Own delivery of large ETL landscapes built on Ab Initio GDE graphs Cooperating deployment EME metadata
  • Define and enforce an Ab Initio specific delivery model component library governance naming conventions asset versioning in EME release pipelines for graphs and sandboxes
  • Set organization level standards for metadata driven development shared enterprise components and reuse of transform libraries and parameter sets
  • Lead major production incident response for Ab Initio stacks triage root cause postmortem defect to change feedthrough

Similar Jobs

More Jobs at LTM

More Information Technology Jobs

Find similar Specialist - Data Engineering jobs: