Senior Data Ops Engineer (Azure Databricks)Role OverviewWe are hiring a Senior DataOps Engineer to drive enterprise DataOps capabilities, ensuring reliable, scalable, and production-ready data pipelines on Azure Databricks platforms. This role focuses on pipeline orchestration, CI/CD automation, monitoring, and data platform operations to support analytics and AI/ML workloads.
Key Responsibilities- Build and manage end-to-end data pipelines using Azure Databricks (PySpark, SQL)
- Implement workflow orchestration (Airflow / ADF / Databricks Workflows)
- Establish Data Ops practices: monitoring, alerting, and production support
- Drive CI/CD pipelines and environment promotion (Dev 12 Prod)
- Ensure data quality, lineage, and governance compliance
- Manage incident resolution, RCA, and SLA adherence
- Optimize pipeline performance, scalability, and cost
- Data Ops function ensures consistent, reliable data delivery and operational stability across platforms
Required Skills- Azure Databricks (Mandatory) - PySpark, SQL
- Azure Services - ADF, ADLS, Synapse
- Data Orchestration - Airflow / ADF / Databricks Workflows
- CI/CD Tools - Azure DevOps / GitHub / Git
- Strong expertise in ETL/ELT pipelines, DataOps, and production support
- Experience with data quality, monitoring, and observability frameworks
Preferred Skills- Experience with Snowflake / BigQuery / multi-cloud environments
- Exposure to MLOps / AI data pipelines
- Knowledge of Medallion Architecture (Bronze-Silver-Gold)
Domain Experience (Good to Have)- US Healthcare domain knowledge:
- Claims, Member, Provider, Eligibility data
- Familiarity with FHIR / HL7 / EMR data models
Experience: 10+ Years
Education: Bachelor19s Degree (4-year) - Computer Science / Engineering / Related Field
Pay:The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Fractal, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is: $130,000 - $160,000. In addition, you may be eligible for a discretionary bonus for the current performance period.
Benefits:As a full-time employee of the company or as an hourly employee working more than 30 hours per week, you will be eligible to participate in the health, dental, vision, life insurance, and disability plans in accordance with the plan documents, which may be amended from time to time. You will be eligible for benefits on the first day of employment with the Company. In addition, you are eligible to participate in the Company 401(k) Plan after 30 days of employment, in accordance with the applicable plan terms. The Company provides for 11 paid holidays and 12 weeks of Parental Leave. We also follow a "free time" PTO policy, allowing you the flexibility to take time needed for either sick time or vacation.
If you like wild growth and working with happy, enthusiastic over-achievers, you19ll enjoy your career with us!
Hiring Related QueriesOutside India:
[email protected]This inbox does not process resume submissions. All applications must be made through posted job openings
Not the right fit? Let us know you19re interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!
