DataArt

Senior Data Engineer

DataArt • $150K — $180K *
New York, NY 10025In-Person
Enterprise Technology
Less than 5 years of experience
Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • 3+ years of experience managing Databricks.
  • 3+ years with Azure integrated services.
  • 3+ years of object-oriented programming in Python.
  • Experience with Git-based workflows and CI/CD tools.
  • Strong background in data pipeline security and governance.

Responsibilities

  • Manage Databricks instances and associated datasets.
  • Establish automated data import pipelines for the warehouse.
  • Implement automated data refresh and validation processes.
  • Handle daily reporting and respond to data requests.
  • Collaborate on data policies and governance.
  • Ensure data quality and availability for users.
  • Serve as the main contact for organizational data projects.

Benefits

  • In-office work environment four days a week.
Full Job Description
Position overview

We are seeking a skilled Data Engineer with experience in Databricks, Snowflake, SQL Server, and cloud technologies. In this role, you will support and manage the organization's data environment, ensuring reliable data availability and quality. You will serve as a central point of contact for data projects and requests across the organization. The ideal candidate is an independent problem solver with strong communication skills and the ability to work effectively in a rapidly changing environment. The estimated salary range for this position is USD 150,000 to 180,000 per year. This role involves four in-office days per week.

Responsibilities

  • Manage Databricks instances, including onboarding datasets, permissions, security, and governance.
  • Set up centralized, automated pipelines to import various data sources into the data warehouse.
  • Set up automated processes for data refreshes, data validation, and monitoring in the data warehouse.
  • Manage day-to-day reporting and data requests.
  • Collaborate on data policy and governance.
  • Ensure data quality and easy data availability for end users.
  • Be the central point of contact for organization-wide data requests and projects.


Requirements

  • 3+ years of strong experience in Databricks management.
  • 3+ years of experience working with integrated services on Azure.
  • 3+ years of experience with object-oriented programming in Python.
  • 1+ year of experience with agentic coding assistants.
  • Strong experience in pipeline creation, security, governance, and Change Data Capture (CDC).
  • Demonstrated ability to independently diagnose and resolve pipeline and data quality issues.
  • Experience integrating and ingesting data from external APIs.
  • Experience deploying production-ready data assets with minimal oversight.
  • Experience with Git-based workflows and CI/CD (e.g., GitHub Actions).
  • Experience designing data monitoring and validation frameworks.
  • Proficiency in database design, optimization, and performance tuning.
  • Experience in data normalization and compression techniques to optimize data size and performance.
  • Ensure data integrity, security, and performance in the modernized database environment.
  • Should be comfortable working in a rapidly changing environment with ambiguous requirements.
  • Familiarity with orchestration tools.
  • Strong communication and interpersonal skills, with the ability to communicate with business users.
  • Must be able to work independently with minimal guidance.
  • Experience with financial data, such as trade data, reference data, position data, etc., to build functional calculation modules, reports, and dashboards.
  • Familiarity with reporting tools such as Tableau and Sigma is preferred.

About DataArt

DataArt is a global technology consultancy that designs, develops, and supports unique software solutions, helping clients take their businesses forward. The company offers a wide range of services, including custom software development, technology consulting, and software testing and quality assurance. DataArt serves clients in a variety of industries, including finance, healthcare, and travel and hospitality.
Learn more about DataArt
Size
3,000 employees
Industry
Information Technology
Founded
1997
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at DataArt

  • DataArt
    Senior Data Engineer
    $150K — $180K *
    New York, NY 10025 (New York County)
    Today
    Enterprise Technology
    In-Person

More Enterprise Technology Jobs

Find similar Senior Data Engineer jobs:

NationwideNew York, NY