Take ownership of features and drive them to completion through all phases of the entire 84.516 SDLC. This includes internal and external facing applications as well as process improvement activities:
- Participate in the design and development of Databricks and Cloud-based solutions
- Implement automated unit and integration testing
- Collaborate with architecture and lead engineers to ensure consistent development practices
- Provide mentoring to junior engineers
Collaborate within a cross-functional team of data scientists, Product partners, and engineers to translate analytical needs into reliable data pipelines and scalable solutions
- Participate in retrospective reviews
- Participate in the estimation process for new work and releases
- Collaborate with other engineers to solve and bring new perspectives to complex problems
- Drive improvements in data engineering practices, procedures, and ways of working
- Embrace new technologies and an ever-changing environment
- Prepare, validate, and organize governed data and metadata to support reliable analytics and downstream data consumers.
QUALIFICATIONS, SKILLS, AND EXPERIENCE
- Bachelor's Degree (Computer Science, Management Information Systems, Mathematics, Business Analytics, or STEM)
- 3+ years proven ability of professional Data Development experience
- 3+ years proven ability of developing with Databricks
- 3+ years of experience with PySpark/Spark
- 3+ years of experience developing with either Python or Java
- Full understanding of ETL concepts and Data Warehousing concepts
- Experience with Pipeline Orchestration
- Experience with CI/CD
- Experience with version control software
- Strong understanding of Agile Principles (Scrum)
- Experience preparing and validating data for downstream consumers, with an emphasis on data quality, governance, and clear metadata documentation.
BONUS POINTS FOR EXPERIENCE IN THE FOLLOWING
- Experience with Azure
- Experience with Databricks Delta Tables, Delta Lake, Delta Live Tables
- Proficient with Relational Data Modeling
- Experience with Python Library Development
- Experience with Structured Streaming (Spark or otherwise)
- Experience with Kafka and/or Azure Event Hub
- Experience with Github SaaS / Github Actions
- Exposure to BI Tooling (Tableau, Power BI, Cognos, etc.)
- Experience with Kubernetes and Azure Kubernetes Service (AKS).
- Experience building APIs with FastAPI.
#LI-AB1
Pay Transparency and Benefits
- The stated salary range represents the entire span applicable across all geographic markets from lowest to highest. Actual salary offers will be determined by multiple factors including but not limited to geographic location, relevant experience, knowledge, skills, other job-related qualifications, and alignment with market data and cost of labor. In addition to salary, this position is also eligible for variable compensation.
- Below is a list of some of the benefits we offer our associates:
- Health: Medical: with competitive plan designs and support for self-care, wellness and mental health. Dental: with in-network and out-of-network benefit. Vision: with in-network and out-of-network benefit.
- Wealth: 401(k) with Roth option and matching contribution. Health Savings Account with matching contribution (requires participation in qualifying medical plan). AD&D and supplemental insurance options to help ensure additional protection for you.
- Happiness: Paid time off with flexibility to meet your life needs, including 5 weeks of vacation time, 7 health and wellness days, 3 floating holidays, as well as 6 company-paid holidays per year. Paid leave for maternity, paternity and family care instances.
Base Pay Range
$121,000-$169,000 USD
