The Impact You Will Drive:- As a foundational member of the Data Infrastructure team, you will productionize the next generation of our data tech stack by building the software and data features that actually process all of the data we ingest.
- Accelerate our open source <> enterprise flywheel by working on the guts of Apache Hudi's transactional engine and optimizing it for diverse Onehouse customer workloads.
- Act as a SME to deepen our teams' expertise on database internals, query engines, storage and/or stream processing.
A Typical Day:- Design new concurrency control and transactional capabilities that maximize throughput for competing writers.
- Design and implement new indexing schemes, specifically optimized for incremental data processing and analytical query performance.
- Design systems that help scale and streamline metadata and data access from different query/compute engines.
- Solve hard optimization problems to improve the efficiency (increase performance and lower cost) of distributed data processing algorithms over a Kubernetes cluster.
- Leverage data from existing systems to find inefficiencies, and quickly build and validate prototypes.
- Collaborate with other engineers to implement and deploy, safely rollout the optimized solutions in production.
What You Bring to the Table:- Strong, object-oriented design and coding skills (Java and/or C/C++ preferably on a UNIX or Linux platform).
- Experience with inner workings of distributed (multi-tiered) systems, algorithms, and relational databases.
- You embrace ambiguous/undefined problems with an ability to think abstractly and articulate technical challenges and solutions.
- An ability to prioritize across feature development and tech debt with urgency and speed.
- An ability to solve complex programming/optimization problems.
- An ability to quickly prototype optimization solutions and analyze large/complex data.
- Robust and clear communication skills.
- Nice to haves (but not required):
- Experience working with database systems, Query Engines or Spark codebases.
- Experience in optimization mathematics (linear programming, nonlinear optimization).
- Existing publications of optimizing large-scale data systems in top-tier distributed system conferences.
- PhD degree with 2+ years industry experience in solving and delivering high-impact optimization projects.
How We'll Take Care of You -
Competitive Compensation; the estimated base salary range for this role is
$215,000 - $250,000-Equity Compensation; our success is your success with eligible participation in our company equity plan
-
Health & Well-being; we'll invest in your physical and mental well-being with up to 90% health coverage (50% for spouses/dependents) including comprehensive medical, dental & vision benefits
-
Financial Future; we'll invest in your financial well-being by making this role eligible to contribute to our company 401(k) or Roth 401(k) retirement plan
-
Location; we are a remote-friendly company (internationally distributed across N. America + India), though some roles will be subject to in-person requirements in alignment with the needs of the business
-
Generous Time Off; unlimited PTO (mandatory 1 week/year minimum), uncapped sick days and 11 paid company holidays
-
Company Camaraderie;-
Food & Meal Allowance; weekly lunch stipend, in-office snacks/drinks
-
Equipment; we'll provide you with the equipment you need to be successful and a one-time $500 stipend for your initial desk setup
-
Child Bonding!; 8 weeks off for parents (birthing, non-birthing, adoptive, foster, child placement, new guardianship) - fully paid so you can focus your energy on your newest addition
