5+ years of experience as an Abinitio Developer or similar role
Expertise in GDE graph authoring and debugging
Strong knowledge of SQL and Unix shell scripting
Familiarity with the Hadoop ecosystem
Proficient in writing auxiliary shell scripts for testing and post-processing functions
Responsibilities
Architect and implement robust ETL processes to meet performance targets
Lead and mentor a team of developers in Abinitio delivery
Conduct thorough code reviews to enhance graph quality and performance
Investigate performance issues and recommend solutions for ETL optimization
Prepare test datasets and performance testing scripts
Collaborate with operations on scheduling and restart strategies
Define and enforce governance standards for ETL development processes
Benefits
Opportunity to work with leading ETL technologies
Collaborative work environment focused on mentoring
Exposure to large-scale data projects
Professional development opportunities in advanced data engineering
Participation in significant production incident management and resolution processes
Full Job Description
Role description
Job Title: Abinitio Developer
Work Location : Tampa, Florida
Job Summary
Architect and implement core ETL graphs choose partitioning keys sort merge strategies and memory settings to meet SLAs
Handson technical lead for a Ab Initio delivery team design graphs enforce standards mentor devs own performance and production readiness for assigned modules
Do deep code reviews of GDE graphs naming parameterization component reuse error handling and logging
Lead performance investigations identify skew repartition points costly sorts and recommend rewrite partitioning improvements
Prepare test datasets and scripts for unitregression performance testing
Work with Ops to ensure Cooperating scheduling appropriate restart strategies and runbook snippets for each graph
Working Basic knowledge in Bigdata Hadoop Eco system
Experience and expertise on SQL and Unix shell scripting Knowledge on Abinitio air commands and m commands
Must have technical skills
Expert with GDE graph authoring and debugging comfortable editing cfg parameter files and using graph debuggers logs
Strong knowledge of Ab Initio operators Join Reformat Dedup Rollup Aggregate Rank Sort Partition Merge Lookup and when to use each optimally in a parallel environment
Mastery of partitioning strategies and the impact on network IO memory and merge sort costs
Familiarity with EME for metadata component check-ins and versioning
Ability to write auxiliary shell scripts and SQL for test data and postprocessing
Own delivery of large ETL landscapes built on Ab Initio GDE graphs Cooperating deployment EME metadata
Define and enforce an Ab Initio specific delivery model component library governance naming conventions asset versioning in EME release pipelines for graphs and sandboxes
Set organization level standards for metadata driven development shared enterprise components and reuse of transform libraries and parameter sets
Lead major production incident response for Ab Initio stacks triage root cause postmortem defect to change feedthrough