Experience in building data ingestion and validation pipelines
Responsibilities
Build and enhance LoRA and full fine-tuning workflows using PyTorch, PEFT, and CUDA
Own the dataset ingestion, transformation, and validation processes
Collaborate with other platform teams to adhere to existing configuration and logging contracts
Benefits
Opportunity to work on cutting-edge AI technologies
Collaborative environment with cross-team interactions
Focus on self-service platform development
Access to advanced GPU infrastructure for training tasks
Full Job Description
AI Engineer1 We're building a self-service LoRA / full fine-tuning platform for LLMs, deployed on AKS. This role owns the training pipeline and data pipeline - turning raw datasets into validated training inputs and running LoRA/full fine-tuning jobs on GPU infrastructure.
What you'll do
Build and improve LoRA and full fine-tuning workflows (PyTorch + PEFT + CUDA)
Own dataset ingestion, transformation, and validation
Work within existing config and logging contracts shared with other platform teams
What you need
Strong Python and hands-on PyTorch experience
Experience with LoRA or full fine-tuning of LLMs
Comfort debugging CUDA/GPU training workloads
Experience building data ingestion/validation pipelines
