Senior Data Engineer - Python

Cleartelligence

$120K — $160K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 7+ years in Data Engineering and Python development
  • Expert-level proficiency in Python programming
  • Experience designing ETL/data ingestion pipelines
  • Strong familiarity with APIs, MySQL, and PostgreSQL
  • Proficiency in SQL
  • Experience with Git/GitHub for version control
  • Ability to work independently with minimal supervision
  • Excellent analytical and problem-solving skills

Responsibilities

  • Design, develop, and maintain Python-based data ingestion and ETL pipelines
  • Extract data from legacy and enterprise systems including APIs and databases
  • Transform, validate, and load data into SQL databases using Python scripts
  • Support the migration of existing data feeds to a new environment
  • Maintain source code in GitHub and manage deployments
  • Monitor, troubleshoot, and optimize data pipelines for performance
  • Collaborate with stakeholders to implement scalable data solutions
  • Document data flows and technical solutions for clarity

Benefits

  • Opportunity to work in a fast-paced environment
  • Potential for professional growth in data engineering
  • Involvement in a large-scale data migration initiative
  • Collaboration with engineering and business teams
  • Location flexibility with some onsite work in New York City
Full Job Description
We are seeking a highly experienced Senior Data Engineer with strong Python development skills to support a large-scale data migration initiative. This individual will build and maintain data ingestion pipelines that extract data from legacy and enterprise systems, transform it, and load it into SQL databases for downstream reporting and analytics.

The ideal candidate is a self-sufficient engineer who is comfortable working across APIs, databases, and ETL pipelines, with the ability to independently deliver high-quality solutions in a fast-paced environment.

Location is commutable to New York City with some onsite work in New York
Responsibilities
  • Design, develop, and maintain Python-based data ingestion and ETL pipelines.
  • Extract data from legacy/homegrown securities platforms, REST APIs, MySQL, PostgreSQL, Microsoft System Center, MDM tools, and similar enterprise systems.
  • Develop Python scripts to transform, validate, and load data into MySQL and PostgreSQL databases.
  • Support migration of existing data feeds into a new environment while ensuring data quality and reliability.
  • Maintain source code in GitHub and support deployment through Bloomberg's internal scheduling platform.
  • Monitor, troubleshoot, and optimize data pipelines.
  • Collaborate with engineering and business stakeholders to implement scalable data solutions.
  • Document data flows, processes, and technical solutions.
Required Qualifications
  • 7+ years of Data Engineering and Python development experience.
  • Expert-level Python programming.
  • Strong ETL/data ingestion pipeline experience.
  • Experience with APIs, MySQL, and PostgreSQL.
  • Strong SQL skills.
  • Experience using Git/GitHub.
  • Ability to work independently with minimal oversight.
  • Strong analytical and troubleshooting skills.
Preferred Qualifications
  • Data modeling or data warehouse experience.
  • Financial services or securities data experience.
  • Experience with enterprise infrastructure management systems.
  • Experience supporting large-scale data migration initiatives.
  • Exposure to enterprise scheduling/orchestration tools.
What We're Looking For
  • Senior-level engineer capable of owning data ingestion pipelines end-to-end, from extracting data from legacy systems through transforming and loading it into modern SQL environments with minimal supervision.
Nice-to-Have Skills
  • Data modeling and dimensional modeling
  • Data warehouse architecture
  • Financial services experience

The anticipated hourly rate for this role is up to $100 per hour or between $120,000 - $160,000 annually. Final pay rate will be determined based on experience, qualifications and geographic location

Similar Jobs

More Information Technology Jobs

Find similar Senior Data Engineer - Python jobs: