Data EngineerDepartment: Engineering
Employment Type: Permanent - Full Time
Location: New York
Compensation: $94,500 - $115,000 / year
DescriptionWe are looking for a
Data Engineer with strong
Microsoft SQL Server and Snowflake experience to join our Data & Analytics engineering team.
This role is ideal for an engineer who enjoys working with
large-scale data, complex SQL, data pipelines, and production systems and wants to play a key role in modernizing a large SQL Server-based data platform to Snowflake and AWS.
You will work across both our existing SQL Server environment and our modern cloud data platform, developing new capabilities while helping migrate and optimize existing data processing.
Tech Stack- Languages: SQL, Python, C#; scripting experience
- Databases: Microsoft SQL Server, Snowflake
- Data Engineering: ETL/ELT, Apache Airflow, data pipelines
- Cloud: AWS, including S3 and other AWS data services
- Development: Git, CI/CD, Liquibase, automated testing and deployment
- Data: Market data, trade data, transaction cost analysis, and financial data
Key Responsibilities- Develop, maintain, and optimize complex SQL Server queries, stored procedures, functions, views, and data processing workflows.
- Design and develop scalable Snowflake data solutions, including data models, SQL transformations, loading processes, and analytical workloads.
- Participate in the migration of large volumes of data and processing from SQL Server to Snowflake.
- Analyze existing SQL Server logic and translate or redesign it for Snowflake where appropriate.
- Build and maintain ETL/ELT pipelines using SQL, Python, and workflow orchestration tools such as Apache Airflow.
- Develop data ingestion and processing workflows using AWS, including S3.
- Perform SQL Server and Snowflake performance tuning, including query optimization, execution plans, indexing, statistics, warehouse sizing, and workload optimization.
- Build data validation and reconciliation processes to ensure migrated and transformed data is accurate and complete.
- Troubleshoot production data issues, identify root causes, and implement reliable long-term solutions.
- Implement monitoring, logging, alerting, and operational controls for critical data pipelines.
- Collaborate with software engineers, service managers and implementation team, product teams, and DevOps.
- Support and enhance existing Transaction Cost Analysis (TCA) products and develop new functionality.
- Work with large-scale trade, market, benchmark, and financial data.
Skills, Knowledge and ExpertiseEssential Skills & ExperienceEducational Background:
- Bachelor's degree in Computer Science, Data Engineering, or a related field.
Technical Skills:
- Hands-on experience with Snowflake and AWSCloud services (particularly S3 and data services).
- Strong hands-on SQL development experience.
- Python & C# scripting experience
- Strong experience with Microsoft SQL Server, including complex queries, stored procedures, performance tuning, and troubleshooting.
- Experience working with large datasets and production data systems.
- Strong analytical and problem-solving skills.
Desirable Skills & Experience- Experience migrating SQL Server workloads to Snowflake or another cloud data platform.
- Experience with Apache Airflow or similar orchestration technologies.
- Experience with Git, CI/CD, Liquibase and automated deployment processes.
- Experience with data quality, reconciliation, and data governance.
- Knowledge of capital markets, trading, market data, or financial systems.
- Experience with Transaction Cost Analysis (TCA) or other financial analytics.
- Snowflake or AWS certification.
AI-Assisted Development:
- We encourage engineers to use modern AI-assisted development tools, such as Claude Code to accelerate development, debugging, testing, refactoring, and migration work.
- Candidates should understand how to use AI effectively while independently validating generated code for correctness, security, performance, and maintainability.
BenefitsCompetitive Benefits & Perks We offer a comprehensive benefits package designed to support your well-being, growth, and work-life balance.
- Health & Financial Security:
- Medical, Dental, and Vision insurance
- Flexible Spending Accounts (FSA) & Health Savings Accounts (HSA)
- 401(k) retirement plan
- Pre-tax transit and parking benefits
- Time Off & Flexibility:
- Enjoy the best of both worlds: the energy and collaboration of in-person work, combined with the convenience and focus of remote days. This is a hybrid position requiring three days of in-office collaboration per week, with the flexibility to work remotely for the remaining two days. Our hybrid model is designed to balance individual flexibility with the benefits of in-person collaboration, enhanced team cohesion, spontaneous innovation, hands-on mentorship opportunities and strengthens our company culture.
- 22 days of Paid Time Off (PTO) per year, with the option to roll over unused days.
- One dedicated day per year for volunteering.
- Two professional development days per year to allow uninterrupted professional development.
- An additional PTO day added during milestone anniversary years.
- Robust paid holiday schedule with early dismissal.
- Generous parental leave for all parents (including adoptive parents).
- Work-Life Support & Resources:
- Budget for tech accessories, including monitors, headphones, keyboards, and other office equipment.
- Backup child and pet care, as well as tutoring services.
- Milestone anniversary bonuses.
- Wellness & Lifestyle Perks:
- Stipend and subsidy contributions toward personally-owned cell phones
- Contributions for gym memberships and health/wellness initiatives.
- Discounted healthcare premiums.
- Healthy meal delivery program subsidies.
