We are looking for an experienced Data Engineer to join our growing data warehouse team. You will be responsible for profiling, analyzing, processing and loading the vast amounts of payment data we have. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys the challenge of precision-based quality and high-throughput performance engineering. You will be part of a small team that works on data initiatives to deliver information products to our Business Intelligence community. You will be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing our existing architecture and re-shaping it to leverage the next-generation, cloud-native tools.
Essential Duties and Responsibilities:
• Collaborate on design and maintain optimal data pipelinearchitecture. • Analyze and process large, complex data sets to meet functional and non-functional business requirements. • Assist team to build theinfrastructurerequired for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and related ‘big data’ technologies. • Deliver quality of work via unit testing. • Ensure performance of code meets non-functional requirements. • Work with stakeholders including the Management, Product, Data and Design teams to assist with data-related technical issues. • Responsible for engaging with productionsupport staff and remediating chronic and/or critical productionsupport issues. • Responsible for monitoring more juniordeveloper andcontracted staff.
Minimum Required Qualifications for Consideration:
• Bachelor’s degree in Computer Science, Engineering or Information Systems. • Minimum 4 years+ experience designing and coding data pipeline programs, particularly in a data warehousing or analytics environment. • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. • Strong analytic skills related to working with structured and unstructured datasets. • Build processes supporting data transformation, data structures, metadata, dependency and workload management. • A successful history of manipulating, processing and extracting value from large disconnected datasets. • Experience supporting and working with cross-functional teams in a dynamic environment. • Excellent verbal and written communication skills.