Full Job Description
Position Summary
Job Description
Senior Databricks Data Engineer - Reliability: Designs, develops, and optimizes production Data Products on the Databricks Lakehouse Platform running on AWS, with reliability, observability, performance, scalability, and cost efficiency engineered directly into the solutions built. Engineers monitoring, logging, metrics, dashboards, and proactive alerting to improve diagnostics and production visibility. Identifies recurring reliability issues, performs root cause analysis for complex production issues, and automates recovery and operational activities where practical. Optimizes Spark workloads, Delta Lake, Databricks compute, SQL Warehouses, and storage, diagnosing performance bottlenecks and engineering sustainable improvements while continuously optimizing Databricks and AWS cost efficiency. Develops reusable observability and production-readiness patterns and recovery procedures, supporting appropriate resilience and business continuity requirements. Codes production-grade ETL/ELT and data-processing pipelines using Python/PySpark, SQL, Spark, and Delta Lake, following approved data models and Medallion Architecture patterns. Leads technical reviews and mentors engineers on Databricks development, observability, troubleshooting, and performance optimization. Note: May be internal or external-facing, working in conjunction with Platform Engineering, Governance Engineering, and enterprise architecture functions. May include enterprise-wide, AI-enabled data solutions.
Supervisory Responsibilities
This position has no supervisory responsibilities.
Job Level Description
Works on complex assignments that regularly require the application of independent judgment within approved architecture and engineering standards. Mentors less experienced engineers on Databricks development, observability, troubleshooting, and performance optimization. Participates in production-readiness, performance, and reliability engineering reviews. Able to anticipate and address production reliability, performance, and resilience risks before they reach production.
Qualifications
Education Bachelor's degree in Computer Science, Engineering, Information Systems, or related discipline required.
Years of Related Experience 6+ years of related experience, including 3+ years of hands-on Databricks experience developing and supporting production data solutions.
Physical Requirements The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. While performing the duties of this job, the employee is regularly required to sit, stand, walk, bend, use hands, operate a computer, and have specific vision abilities to include close and distance vision, and ability to adjust focus working with computer and business equipment.
Work Conditions Scientific Games, LLC and its affiliates (collectively, "SG") are engaged in highly regulated gaming and lottery businesses. As a result, certain SG employees may, among other things, be required to obtain a gaming or other license(s), undergo background investigations or security checks, or meet certain standards dictated by law, regulation or contracts. In order to ensure SG complies with its regulatory and contractual commitments, as a condition to hiring and continuing to employ its employees, SG requires all of its employees to meet those requirements that are necessary to fulfill their individual roles. As a prerequisite to employment with SG (to the extent permitted by law), you shall be asked to consent to SG conducting a due diligence/background investigation on you.
This job description should not be interpreted as all-inclusive; it is intended to identify major responsibilities and requirements of the job. The employee in this position may be requested to perform other job-related tasks and responsibilities than those stated above.