Specialist - Data Engineering

LTM

$100K — $120K *
Tampa, FL 33647In-Person
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience as an Abinitio Developer or similar role
  • Expertise in GDE graph authoring and debugging
  • Strong knowledge of SQL and Unix shell scripting
  • Familiarity with the Hadoop ecosystem
  • Proficient in writing auxiliary shell scripts for testing and post-processing functions

Responsibilities

  • Architect and implement robust ETL processes to meet performance targets
  • Lead and mentor a team of developers in Abinitio delivery
  • Conduct thorough code reviews to enhance graph quality and performance
  • Investigate performance issues and recommend solutions for ETL optimization
  • Prepare test datasets and performance testing scripts
  • Collaborate with operations on scheduling and restart strategies
  • Define and enforce governance standards for ETL development processes

Benefits

  • Opportunity to work with leading ETL technologies
  • Collaborative work environment focused on mentoring
  • Exposure to large-scale data projects
  • Professional development opportunities in advanced data engineering
  • Participation in significant production incident management and resolution processes
Full Job Description
Role description

Job Title: Abinitio Developer

Work Location : Tampa, Florida

Job Summary

  • Architect and implement core ETL graphs choose partitioning keys sort merge strategies and memory settings to meet SLAs
  • Handson technical lead for a Ab Initio delivery team design graphs enforce standards mentor devs own performance and production readiness for assigned modules
  • Do deep code reviews of GDE graphs naming parameterization component reuse error handling and logging
  • Lead performance investigations identify skew repartition points costly sorts and recommend rewrite partitioning improvements
  • Prepare test datasets and scripts for unitregression performance testing
  • Work with Ops to ensure Cooperating scheduling appropriate restart strategies and runbook snippets for each graph
  • Working Basic knowledge in Bigdata Hadoop Eco system
  • Experience and expertise on SQL and Unix shell scripting Knowledge on Abinitio air commands and m commands
  • Must have technical skills
  • Expert with GDE graph authoring and debugging comfortable editing cfg parameter files and using graph debuggers logs
  • Strong knowledge of Ab Initio operators Join Reformat Dedup Rollup Aggregate Rank Sort Partition Merge Lookup and when to use each optimally in a parallel environment
  • Mastery of partitioning strategies and the impact on network IO memory and merge sort costs
  • Familiarity with EME for metadata component check-ins and versioning
  • Ability to write auxiliary shell scripts and SQL for test data and postprocessing
  • Own delivery of large ETL landscapes built on Ab Initio GDE graphs Cooperating deployment EME metadata
  • Define and enforce an Ab Initio specific delivery model component library governance naming conventions asset versioning in EME release pipelines for graphs and sandboxes
  • Set organization level standards for metadata driven development shared enterprise components and reuse of transform libraries and parameter sets
  • Lead major production incident response for Ab Initio stacks triage root cause postmortem defect to change feedthrough

Similar Jobs

More Jobs at LTM

More Information Technology Jobs

Find similar Specialist - Data Engineering jobs: