Job DescriptionThis opportunity requires experience with Lakehouse architecture, cloud-native integration patterns, and expertise with the latest data engineering best practices to deliver clean, automated, well-documented and auditable data products for enterprise consumers and analytics. This collaborative role works closely with product owners and engineering leads to translate business and regulatory needs, including data ingestion, lineage, PII protection, and quality goals, into an automated future-forward data platform using AI-powered software engineering to develop secure, extensible and well-tested code within an enterprise data ecosystem.
Responsibilities
Key responsibilities include:
- Design, build and maintain data ingestion, discovery and consumption pipelines across file-based feeds, APIs, change-data-capture and streaming sources, driven by reusable, declarative data contracts
- Collaborate with product owners, engineering leads and data stewards to gather and implement requirements, ensuring data pipelines and contracts reflect prioritized business imperatives
- Own the onboarding of new data sources end-to-end through pipeline development, field mapping, type management, enrichment and quality/privacy rule definitions
- Work with orchestration and metadata systems to process event, dependency and schedule-driven activities
- Support and extend the downstream data models that power business intelligence and reporting
- Apply modern software engineering practices to ensure pipeline changes are well-specified and production ready, backed by automated unit and end-to-end tests
- Use AI-assisted development tools for coding, testing and documentation, while staying accountable for correctness, security and sound architecture
- Participate in CI/CD and DevOps best practices for data platform development, validation and deployment
- Monitor pipeline health and data processing in production, troubleshooting and routing issues to the appropriate remediation process
- Maintain documentation, including operational runbooks, to capture and share data platform knowledge and insights
Experience & Education
- Bachelor's degree in computer science or equivalent experience
- 5+ years of programming experience with an advanced, object-oriented language (Python preferred)
- 4+ years of hands-on experience with SQL, writing efficient code for high-volume data processing and supporting high-performing ETL processes, including data quality and testing practices
- 3+ years of hands-on experience with data warehousing/Lakehouse design and implementation on cloud-based platforms (e.g. AWS, Databricks, Snowflake)
- Experience with event-driven data ingestion patterns and Lakehouse table formats (e.g. Apache Iceberg)
- Experience with CI/CD and infrastructure-as-code practices
- Experience with Agile development methodologies
What we give you in return:Not many teams can say that they support people's dreams coming to life. We happen to do that every day. And as important as we know your career is, we recognize that there's a whole lot more to life. To ensure that our employees can make the most of their time outside of working hours, we offer a competitive salary and for full-time roles, a benefits package including:
- Inclusive health, dental, vision, and life insurance plans built to support diverse lifestyles, offer preventative care, and protect against hardship.
- Easy access to mental health benefits to meet our team members and their families where they are.
- 20+ days of paid time off (PTO), paid holidays, and 2 paid wellness days to give our employees the time they need to stay close with their loved ones, recharge, and give back to their communities.
- 401(k) savings plan with a generous company contribution (up to 5%), and access to a financial professional to offer our employees the opportunity to plan-ahead for a strong financial future well beyond their working years.
- Paid parental leave to support all team members with birth, adoption, and fostering.
- Health Savings and Flexible Spending Account options to help you save money on healthcare, daycare, commuting, and more.
- Employee Assistance Program (EAP), LifeLock, Pet Insurance and more.
- Paid caregiver leave to provide time away from work when caring for an ill or recovering family member.
- Additional benefits such as an Employee Assistance Program (EAP), identity theft protection (LifeLock), pet insurance, and other voluntary benefits to provide extra peace of mind
