Position SummaryWe are seeking a talented and experienced Data Platform Engineer to join our team as the Technical Lead. The ideal candidate will be responsible for designing, developing, and maintaining our data pipelines and infrastructure. They will work closely with cross-functional teams to understand data requirements, implement solutions, and ensure data quality and reliability. The data engineer will also be involved in optimizing data processes and supporting data analytics initiatives.
About the role- Design, build, and maintain scalable data pipelines and infrastructure to support data ingestion, processing, and storage.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and develop solutions to meet business needs.
- Implement data quality checks and ensure data integrity and reliability throughout the data lifecycle.
- Optimize and tune data pipelines for performance and efficiency.
- Troubleshoot and debug data-related issues, and provide timely resolution.
- Stay updated with the latest technologies and best practices in data engineering and apply them to improve existing systems.
- Document data architecture, processes, and workflows.
- Provide support and guidance to junior members of the team.
About you- Bachelor's degree in Computer Science, Engineering, or related field. Master's degree preferred.
- 9+ yrs of proven experience as a data engineer or similar role, with a strong background in data warehousing, ETL/ELT processes, and data modeling.
- Proficiency in programming languages such as Python, Java, or Scala.
- Experience with big data technologies such as BigQuery, Spark, Kafka, DBT, SQLMesh etc.
- Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud.
- Strong SQL skills and experience working with relational and NoSQL databases.
- Familiarity with data visualization tools such as Tableau, Power BI, or Looker.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills, with the ability to work effectively in a team environment.
Preferred Experience- Experience with containerization and orchestration tools such as Docker and Kubernetes.
- Knowledge of machine learning techniques and frameworks.
- Experience with DevOps practices and tools for CI/CD.
Work LocationMountain View, CA - Hybrid (3 days / week onsite)
What you will have at Harness- Competitive salary
- Comprehensive healthcare benefits
- Flexible Spending Account (FSA)
- Flexible work schedule
- Employee Assistance Program (EAP)
- Flexible Time Off and Parental Leave
- Monthly, quarterly, and annual social and team building events
- Monthly internet reimbursement
Pay transparency
$180,000-$220,000 USD
Harness in the news:- Accelerating Our Mission to Bring AI to Everything After Code
- Goldman Sachs leads investment in software delivery startup Harness at $5.5 billion valuation
- How Harness runs 16 "startups within a startup" at scale | Jyoti Bansal
- Harness Research Shows AI Visibility Crisis Fueling Security Nightmare
- Harness has been named to the Inc. Power Partner list for software delivery success
