Data Engineer (Azure Data Platform)

Purple Drive Technologies

$100K — $130K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 8+ years in Data Operations, Data Platform Operations, or SRE/DataOps roles
  • Strong automation-first approach to reduce operational toil
  • Hands-on with incident management and operational tooling
  • Experience with Azure’s data services like Data Factory and Databricks
  • Proficient in CI/CD and release automation using Azure DevOps
  • Knowledgeable in cost governance for data platforms
  • Scripting skills in Python, SQL, and PowerShell for automation tasks

Responsibilities

  • Design and implement automated incident detection frameworks
  • Shift incident response to proactive, policy-driven workflows
  • Build DataOps automation frameworks, applying AIOps for anomaly detection
  • Establish operational runbooks and automated recovery patterns
  • Define platform-wide observability and telemetry standards
  • Create self-service tools for engineering teams to manage issues independently
  • Establish cost governance and optimization frameworks for data platforms

Benefits

  • Opportunities for professional growth and development
  • Access to cutting-edge technologies and tools
  • Collaboration with cross-functional teams
  • Flexible work environment
  • Emphasis on work-life balance
Full Job Description
Overview:

Job Description

Must Have Technical/Functional Skills:

Cosmos; PL/SQL; MSBI; Digital : Microsoft Power BI; Digital : Big Data Platforms

Roles & Responsibilities:

  • Automated Incident Detection & Remediation
  • Design and implement automated incident detection and remediation frameworks for data platforms and pipelines.
  • Shift incident response from reactive manual processes to proactive, policy-driven workflows.
  • Improve mean time to detect (MTTD) and mean time to remediate (MTTR) through automation.
  • DataOps Automation & AIOps Frameworks
  • Build and operationalize DataOps automation frameworks, incorporating AIOps where applicable for anomaly detection and predictive alerting.
  • Reduce operational noise and repetitive manual tasks through intelligent automation.
  • Establish standardized operational runbooks and automated recovery patterns.
  • Platform Observability & Telemetry Standardization
  • Define and implement platform-wide observability and telemetry standards for data workloads.
  • Enable consistent metrics, logging, alerting, and health signals across platforms and pipelines.
  • Ensure operational visibility is actionable and supports automated response.
  • Self-Service Operational Tooling
  • Build self-service operational tooling that enables engineering teams to debug, monitor, and resolve issues independently.
  • Reduce operational dependencies on centralized teams and vendors.
  • Empower teams with standardized dashboards, insights, and tooling.
  • Automated Cost Governance & Optimization
  • Establish automated cost governance and optimization frameworks for data platforms.
  • Improve cost visibility through telemetry, alerts, and policy-based controls.
  • Drive proactive cost management rather than reactive spend reviews.


Required Skills & Experience

  • Strong experience in Data Operations, Data Platform Operations, or SRE/DataOps roles.
  • Proven experience reducing operational toil through automation-first approaches.
  • Hands-on experience with incident management, observability, and operational tooling.
  • Experience operating within or transforming managed services or vendor-led operating models.
  • Strong understanding of cost governance and optimization in data platforms.
  • Hands-on experience with Microsoft Azure data platform services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Microsoft Fabric
  • Experience implementing CI/CD and release automation using Azure DevOps, including Azure Pipelines, repository management, deployment workflows, and environment-based promotion controls.
  • Experience with Microsoft Entra ID, Azure Key Vault, and Microsoft Purview for identity, secrets management, governance, data lineage, and compliance controls.
  • Strong scripting and engineering skills in Python, SQL, and PowerShell to build automation, operational runbooks, telemetry pipelines, and remediation workflows.
  • 8+ years of relevant experience.

Similar Jobs

More Jobs at Purple Drive Technologies

  • Data Modeler
    $100K — $130K *
    Los Angeles, CA 90011 (Los Angeles County)
    Finance & Insurance
    In-Person
  • ServiceNow Architect
    $120K — $150K *
    Malvern, PA 19355 (Chester County)
    Enterprise Technology
    In-Person
  • Guidewire Lead Developer
    $100K — $130K *
    Plano, TX 75025 (Collin County)
    Finance & Insurance
    In-Person
  • Procurement Engineer
    $70K — $95K *
    Loveland, CO 80538 (Larimer County)
    Manufacturing & Automotive
    In-Person
  • Data Modeler
    $100K — $130K *
    Los Angeles, CA 90011 (Los Angeles County)
    Finance & Insurance
    In-Person

More Information Technology Jobs

Find similar Data Engineer (Azure Data Platform) jobs: