About the Role The Omni team at Hark is building the next generation of AI experiences beyond text, enabling models to understand and generate content across multiple modalities, including text, audio, and vision. Our goal is to create seamless, real-time multimodal intelligence that powers intuitive and immersive user experiences.
As part of the Omni team, you will focus on developing large-scale pretraining systems and foundation models. This includes working across the full stack-from data curation and large-scale training infrastructure to model architecture and optimization. You will play a key role in advancing the core capabilities of our models through pretraining at scale.
Responsibilities- Drive research and development in large-scale LLM and multimodal pretraining, focusing on improving model capability through better data, scaling, and architecture.
- Develop and optimize data pipelines for pretraining, including large-scale data curation, filtering, deduplication, and synthetic data generation.
- Design and implement efficient training strategies for foundation models, including distributed training, scaling laws, and optimization techniques.
- Build and improve pretraining infrastructure, including training systems, data pipelines, and compute efficiency.
- Develop evaluation frameworks and internal benchmarks to measure pretraining progress and model capability.
- Collaborate with research and engineering teams to push the frontier of foundation model performance and scalability.
Requirements- Proven track record of improving large-scale neural network performance through advances in pretraining data, modeling, or training systems.
Strong experience with large-scale distributed training (e.g., Megatron, DeepSpeed, or similar frameworks). - Deep understanding of LLM or multimodal pretraining, including data pipelines, scaling behavior, and optimization.
- Experience in data-driven experimentation, systematic analysis, and debugging at scale.
- Experience building or working with large-scale training infrastructure and high-performance computing systems.
- Strong ownership mindset and ability to operate in fast-paced, research-driven environments.
Bonus Qualifications- Experience with multimodal pretraining (text, audio, vision) is a strong plus.
CompensationThe US base salary range for this full-time position is between $180,000 - $450,000 annually.
The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience. The total compensation package may also include additional components/benefits depending on the specific role. This information will be shared if an employment offer is extended.
