Procore Technologies, Inc

Senior Cloud Infrastructure Engineer, AI Platform

Procore Technologies, Inc$140K — $193K *
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of hands-on experience with cloud platforms
  • Strong expertise in Google Cloud Platform (GCP) and Infrastructure as Code (e.g., Terraform)
  • Demonstrated history of performance analysis and infrastructure cost optimization
  • Experience building or working on multi-tenant SaaS platforms
  • Proficiency in setting up end-to-end observability with tools like Prometheus or Grafana

Responsibilities

  • Build and optimize a scalable, multi-tenant data ingestion and vectorization pipeline
  • Create and maintain dashboards and alerts to ensure system health
  • Contribute to performance tuning to achieve millisecond latency
  • Design and implement cost-effective multi-tenant infrastructures for SaaS products

Benefits

  • Hybrid work model with 2 days per week in the Austin office
  • Opportunity for equity compensation and bonus incentive compensation
  • Engagement in cutting-edge AI technology and real-time data processing challenges
  • Collaboration with a talented team focused on building innovative solutions
Full Job Description
We are hiring a Senior Cloud Infrastructure Engineer to build the core infrastructure that powers the next generation of AI agents. Our agents must ingest, enrich, and vectorize massive, multi-modal datasets from over 100 customer sources. The core challenge is twofold: how do we do this in a way that is radically cost-efficient, while still allowing agents to deliver thorough responses in seconds?

This position reports to a Senior Manager, Software Engineering and will be 2 days per week hybrid role in our Austin office. We're looking for someone to join us immediately.

What You'll Do
  • Build & Optimize for Scale & Cost: Implement and optimize our highly scalable, multi-tenant data ingestion and vectorization pipeline, with a relentless focus on improving cost and performance.
  • Implement Robust Monitoring: Create and maintain dashboards, alerts, and logging to ensure system health, identify performance bottlenecks, and provide immediate visibility into production issues.
  • Contribute to Millisecond Latency: Be a key contributor in performance tuning across the stack. You will help identify and eliminate bottlenecks in data retrieval, model inference, and agent response times to ensure a snappy, real-time user experience.
  • Engineer Multi-Tenant Architectures: Design and implement scalable, secure, and cost-effective multi-tenant infrastructures for our SaaS-based AI products, ensuring strict tenant isolation and fair resource allocation.


Required Qualifications
  • 5+ years of hands-on experience with cloud platforms
  • Hands-on experience with cloud platforms, with strong expertise in Google Cloud Platform (GCP) and Infrastructure as Code (e.g., Terraform)
  • A demonstrated history of performance analysis, tuning, and infrastructure cost optimization, with the ability to speak about trade-offs and quantified impact
  • Experience building or working on multi-tenant SaaS platforms
  • Experience setting up end-to-end observability, including logging, metrics, and alerting using tools like Prometheus, Grafana, Datadog, or GCP Operations suite


Preferred Qualifications
  • A fundamental understanding of the challenges in training and serving large machine learning models (e.g., memory constraints, computational complexity)
  • Strong understanding of VectorDBs, LLMs, and Agentic Observability tools (Datagrid uses Milvus for our VectorDB and Arize for agent tracing)
  • Experience with the Gemini API, specifically managing LLM quotas and load balancing
  • Hands-on experience with LLM serving frameworks and optimization techniques (quantization, tensor parallelism, FlashAttention)
  • Experience designing multi-tenant SaaS architectures and implementing resource quotas and cost allocation
  • High-level knowledge of agentic systems and best practices


Additional Information

Base Pay Range:
140,960.00 - 193,820.00 USD Annual

This role may also be eligible for Equity Compensation and/or Bonus Incentive Compensation. Procore is committed to offering competitive, fair, and commensurate compensation. Actual compensation will be based on a candidate's job-related skills, experience, education or training, and location.

About Procore Technologies, Inc

About Procore

Revolutionizing Construction Management

Procore Technologies, founded in 2003 and headquartered in Carpinteria, California, stands at the forefront of construction management solutions. With a commitment to innovation and leadership in the field, Procore offers a comprehensive cloud-based platform designed to streamline construction projects.

A Global Presence

Boasting over 1.6 million users across more than 125 countries, Procore has cemented its reputation as a leader in the industry.

Legacy of Success

The company's rapid growth trajectory and substantial funding underline its impact and the trust it has garnered from leading construction firms worldwide.

Career Opportunities at Procore

A World of Opportunity

Procore's dynamic environment offers a plethora of opportunities for professionals passionate about making a difference in the construction industry.

Building Careers

With roles ranging from technical product management to software engineering, Procore is on the lookout for talent ready to contribute to its mission.

Job Application Process

Your Path to Procore

Navigating the application process at Procore is straightforward, emphasizing transparency and opportunity for all candidates.

How to Apply

Details on submitting your application, crafting your resume to stand out, and tips for preparing for the interview process can be found on Procore’s website.

Leading Roles at Procore

There are several different roles at Procore. Some of the high-paying roles such as Account Executive, Technical Product Manager, and Senior Full Stack Software Engineer promise not just rewards but a chance to contribute to significant projects.

Company Culture and Values

Innovation at Its Core

An exploration of Procore's dedication to innovation, teamwork, and leadership in the construction tech industry.

Cultivating Success Together

How collaboration and a shared vision of success drive Procore's team to new heights.

Benefits and Perks

Beyond the Basics

Procore offers a competitive benefits package, including health care, retirement plans, and work-life balance initiatives. Inquiry with Procore’s HR department for more details.

Training and Development Programs

Investing in Your Growth

Procore is committed to employee advancement through professional development opportunities and training programs.

Employee Testimonials

Real Stories of Advancement

For insights and real stories from current and past employees at Procore, visit their profile on Glassdoor.

Connect with Procore

Visit Procore’s website for more detailed information on how to reach Procore's HR team and inquire about available positions, the application process, and more.
Learn more about Procore Technologies, Inc
Size
2,000 employees
Market Cap
$6.5 billion
Industry
Founded
2002
NASDAQ

Similar Jobs

More Jobs at Procore Technologies, Inc

More Enterprise Technology Jobs

Find similar Senior Cloud Infrastructure Engineer, AI Platform jobs: