Bachelor's degree in Computer Science, Engineering, or related field; Master's preferred.
9+ years of proven experience as a data engineer or similar role with a strong data warehousing background.
Proficient in programming languages such as Python, Java, or Scala.
Experience with big data technologies like BigQuery, Spark, Kafka, and SQLMesh.
Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud.
Strong SQL skills with relational and NoSQL databases.
Familiarity with data visualization tools like Tableau, Power BI, or Looker.
Responsibilities
Design, build, and maintain scalable data pipelines and infrastructure.
Collaborate with scientists and analysts to meet business data needs.
Implement data quality checks and ensure data integrity.
Optimize and tune data pipelines for better performance.
Troubleshoot and debug data-related issues promptly.
Stay updated on data engineering technologies and best practices.
Document data architecture, processes, and workflows.
Benefits
Comprehensive healthcare benefits.
Flexible Spending Account (FSA).
Flexible work schedule and Time Off policies.
Employee Assistance Program (EAP).
Regular social and team-building events.
Monthly internet reimbursement.
Full Job Description
Position Summary
We are seeking a talented and experienced Data Platform Engineer to join our team as the Technical Lead. The ideal candidate will be responsible for designing, developing, and maintaining our data pipelines and infrastructure. They will work closely with cross-functional teams to understand data requirements, implement solutions, and ensure data quality and reliability. The data engineer will also be involved in optimizing data processes and supporting data analytics initiatives. About the role
Design, build, and maintain scalable data pipelines and infrastructure to support data ingestion, processing, and storage.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and develop solutions to meet business needs.
Implement data quality checks and ensure data integrity and reliability throughout the data lifecycle.
Optimize and tune data pipelines for performance and efficiency.
Troubleshoot and debug data-related issues, and provide timely resolution.
Stay updated with the latest technologies and best practices in data engineering and apply them to improve existing systems.
Document data architecture, processes, and workflows.
Provide support and guidance to junior members of the team.
About you
Bachelor's degree in Computer Science, Engineering, or related field. Master's degree preferred.
9+ yrs of proven experience as a data engineer or similar role, with a strong background in data warehousing, ETL/ELT processes, and data modeling.
Proficiency in programming languages such as Python, Java, or Scala.
Experience with big data technologies such as BigQuery, Spark, Kafka, DBT, SQLMesh etc.
Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud.
Strong SQL skills and experience working with relational and NoSQL databases.
Familiarity with data visualization tools such as Tableau, Power BI, or Looker.
Excellent problem-solving and analytical skills.
Strong communication and collaboration skills, with the ability to work effectively in a team environment.
Preferred Experience
Experience with containerization and orchestration tools such as Docker and Kubernetes.
Knowledge of machine learning techniques and frameworks.
Experience with DevOps practices and tools for CI/CD.
Work Location
Mountain View, CA - Hybrid (3 days / week onsite) What you will have at Harness
Competitive salary
Comprehensive healthcare benefits
Flexible Spending Account (FSA)
Flexible work schedule
Employee Assistance Program (EAP)
Flexible Time Off and Parental Leave
Monthly, quarterly, and annual social and team building events
Monthly internet reimbursement
Pay transparency
$180,000-$220,000 USD
Harness in the news:
Accelerating Our Mission to Bring AI to Everything After Code
Goldman Sachs leads investment in software delivery startup Harness at $5.5 billion valuation
How Harness runs 16 "startups within a startup" at scale | Jyoti Bansal
Harness Research Shows AI Visibility Crisis Fueling Security Nightmare
Harness has been named to the Inc. Power Partner list for software delivery success
About Harness
Harness is a continuous delivery platform that helps businesses automate their software delivery processes. The platform offers a range of tools and services to help developers build, test, and deploy software more quickly and efficiently. Harness uses AI and machine learning to optimize the software delivery process, and provides analytics and insights to help teams identify and resolve issues more quickly. The company was founded in 2016 and is headquartered in Santa Clara, California.
