ETL Software Engineer - Azure Data Factory

DESCRIPTION

Cox Automotive is seeking an ETL Software Engineer with Azure Data Factory experience for a full-time employee position based out of our Carmel, IN office.

This will be hybrid" work-from-home role requiring the selected candidate to come into our Carmel office approximately once a week, and potentially up to 10 times a month.

What you will be doing:

• Migrate existing Pentaho ETL integrations to Azure cloud platform
• Develop and maintain data pipelines using Azure Data Factory and other relevant Azure technologies
• Optimize ETL processes for performance and scalability, leveraging Azure services such as Azure Data Factory Mapping Data Flows, Azure Data Lake Analytics, or Azure Synapse Pipelines
• Extract data from various sources, transform it into a usable format, and load it into Azure data storage solutions such as Azure SQL Database, or Azure Synapse Analytics
• Collaborate with cross-functional teams to understand data requirements and design scalable and efficient ETL processes using Azure services
• Identify, design and implement ETL solutions for extraction and integration of data to and from data warehouses and data marts for the purposes of reporting, decision support and analysis
• Analyze business and technical requirements, as well as data warehouse data models, to understand the detailed data management requirements
• Administer, maintain, develop and recommend policies and procedures for ensuring the performance, availability, security and integrity of the company's databases and systems
• Architect solutions to help implement the physical data model for the development and/or production environments
• Perform regular deployments, scheduled maintenance and housekeeping
• Work with business and analysts and solution architects to identify, design and implement custom user interface programs for data management and extraction purposes
• Manage job and activity schedules to promote optimal performance, maximum availability and minimize data latency and data load durations
• Implement data quality checks, data validation, and data cleansing techniques to ensure accuracy and reliability of the data
• Collaborate with data analysts to understand their data needs and provide them with clean, reliable, and well-structured data sets for analysis and modeling
• Ability to Extract, Transform, Load, Manage and Troubleshoot daily transaction files from various processors
• Ability to identify and validate data needs and/or information from external clients and internal staff
• Ability to extract and prepare data for analysis across multiple platforms
• Perform data quality analysis to ensure data integrity and accuracy of production data
• Ability to proactively identify areas for improvement in data performance, quality, and processing

What we require from you:

• Bachelor’s degree in Computer Science or related field plus 0-2+ years of relevant work experience; or a Master's degree plus 2+ years of relevant work experience
• In lieu of a degree, qualified candidates would require 4+ years of relevant professional experience
• Proven experience being accountable for the data /analytics architecture solutions for a given business area -how all the components, subsystems, platforms, and integrations fit together to meet the business needs and how the solution fits in with the greater enterprise context
• Strong experience in data extract transform load (ETL) processes using Azure services, such as Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Azure SQL Database, or Azure Synapse Analytics
• Proficiency in SQL and scripting languages such as Python or PowerShell for data manipulation and transformation
• Technologies include Azure SQL, Cosmos DB, Azure Synapse, Power BI
• Familiarity with data modeling concepts and best practices
• Solid understanding of data integration patterns and techniques
• Experience with data quality management and data governance principles
• Strong problem-solving skills and ability to work in a fast-paced, collaborative environment
• Excellent communication skills to effectively convey technical concepts to both technical and non-technical stakeholders
• Experience with legacy ETL tools such as Pentaho, Informatica.

Drug Testing:

To be employed in this role, you'll need to clear a pre-employment drug test. Cox Automotive does not currently administer a pre-employment drug test for marijuana for this position. However, we are a drug-free workplace, so the possession, use or being under the influence of drugs illegal under federal or state law during work hours, on company property and/or in company vehicles is prohibited.

About Cox Automotive

At Cox Automotive, people of every background are driven by their passion for mobility, innovation and community. We transform the way the world buys, sells, owns and uses cars, accelerating the industry with global powerhouse brands like Autotrader, Kelley Blue Book, Manheim and more. What’s more, we do it all with an emphasis on employee growth and happiness. Drive your future forward and join Cox Automotive today!

About Cox

Cox empowers employees to build a better future and has been doing so for over 120 years. With exciting investments and innovations across transportation, communications, cleantech and healthcare, our family of businesses – which includes Cox Automotive and Cox Communications – is forging a better future for us all. Ready to make your mark? Join us today!

Benefits of working at Cox may include health care insurance (medical, dental, vision), retirement planning (401(k)), and paid days off (sick leave, parental leave, flexible vacation/wellness days, and/or PTO).

Cox is an Equal Employment Opportunity employer - All qualified applicants/employees will receive consideration for employment without regard to that individual’s age, race, color, religion or creed, national origin or ancestry, sex (including pregnancy), sexual orientation, gender, gender identity, physical or mental disability, veteran status, genetic information, ethnicity, citizenship, or any other characteristic protected by law. Cox provides reasonable accommodations when requested by a qualified applicant or employee with disability, unless such accommodations would cause an undue hardship.

Statement to ALL Third-Party Agencies and Similar Organizations: Cox accepts resumes only from agencies with which we formally engage their services. Please do not forward resumes to our applicant tracking system, Cox employees, Cox hiring manager, or send to any Cox facility. Cox is not responsible for any fees or charges associated with unsolicited resumes.