OverviewVTG is seeking a talented and experienced Senior Data Engineer to serve as an integrator between business needs and technical solutions. Must be able to work creatively and efficiently to solve difficult technical problems.
In this dynamic role, you will not only support the team in conditioning financial data but also play a key role in the adoption of modern data engineering practices. Your contributions will directly impact the efficiency and effectiveness of data processing, setting the stage for advanced data analysis and decision-making. The ideal candidate will bring a proven track record of building and implementing ETL processes, with a keen eye for optimizing data for various enterprise applications. If you have a passion for data engineering and are ready to take on a challenge that marries technical prowess with mission-critical analysis, this is the opportunity for you.
What will you do?- As a Data Engineer in this role, you will be at the forefront of transforming financial data into actionable insights for a mission-driven customer.
- Your primary responsibility will be to develop, optimize, and maintain robust ETL processes and data pipelines.
- You will leverage your expertise in Python and SQL to condition and normalize both raw and structured data, enhancing its usability and searchability within downstream enterprise tools. Your work will be pivotal in implementing cutting-edge technology, including AI models, to improve data fidelity and accelerate data engineering tasks.
- Familiarity with Apache Airflow and Apache Hop will be beneficial as you build new and repeatable workflows to support the team's objectives.
- Your success in this position will be bolstered by your ability to work independently as well as collaboratively with a team of technical experts, data managers, and operational stakeholders. Experience with Amazon Web Services (AWS) will be crucial as you deploy scalable solutions in a cloud environment. While not mandatory, a background in Kubernetes will give you an edge, as will any experience with financial data and language translation models.
Do you have what it takes?- Active TS/SCI with Polygraph required.
- Bachelor's degree in computer science, Software Engineering, or related field.
Required Skills:
- Python
- Structured Query Language (SQL)
- Apache Airflow
- Apache Hop
- Experience normalizing raw, unstructured, and structured data
- Ability to work independently and collaboratively
- Experience building, optimizing, and implementing ETL processes and data pipelines
- Experience with Amazon Web Services (AWS)
Desired Skills:- Experience with financial data
- Experience with language translation models
- Experience using Kubernetes
This position is open for current and future positions.
