Software Architect

Harbor Compliance

$120K — $150K *
US-AnywhereRemote in United States
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 10+ years of software engineering experience with 4+ years in an architectural role.
  • Expertise in large-scale legacy system modernization with zero unplanned downtimes.
  • Experience designing production-level AI/ML systems and orchestration at scale.
  • In-depth knowledge of distributed systems, microservices, and cloud-native infrastructure.
  • Hands-on background in AI/ML infrastructure design and optimization.
  • Strong understanding of cloud infrastructure and enterprise security compliance.
  • Skilled at translating business strategies into actionable technical roadmaps.

Responsibilities

  • Define and uphold technical architecture for rapid, quality feature delivery.
  • Lead modernization of legacy systems focusing on risk mitigation and design execution.
  • Develop frameworks for intelligent automation and AI API latency compliance.
  • Act as the primary technical authority to resolve architectural dependencies.
  • Collaborate with leadership to link technical debt reduction to business goals.
  • Create standardized design templates that leverage AI tools for development efficiency.
  • Engage with various teams to ensure practical architectural blueprints.
  • Design architectures for AI routing and governance to manage infrastructure costs.

Benefits

  • Health benefits
  • Flexible paid time off
  • Parental leave
  • Fertility and adoption assistance
  • 401(k) plan
  • Educational reimbursement
Full Job Description
The Software Architect defines, modernizes, and owns the technical architecture that powers the platform at scale. Serving as the ultimate technical authority, this role balances the systematic deconstruction of legacy systems with the design of a highly scalable, secure, and future-ready platform. The Software Architect partners with executive leadership to translate business strategy into high-impact technical blueprints, institutionalizing AI-driven workflows and architectural guardrails that empower engineering teams to ship code rapidly, safely, and predictably.

Key Responsibilities

  • Define and maintain the technical architecture, establishing pragmatic patterns and guardrails that accelerate rapid, high-quality feature delivery.
  • Lead the technical execution for migrating, decoupling, and modernizing legacy systems, owning the sequencing, risk mitigation strategies, and target-state designs to extract core business domains seamlessly.
  • Establish the core shared framework for integrating agentic workflows, intelligent automation, and LLM orchestration across the platform with strict compliance auditability and AI API latency under 100 ms.
  • Act as the definitive technical authority to proactively resolve cross-team architectural dependencies and ensure alignment across infrastructure and codebases.
  • Collaborate with Product leadership and the VP of Engineering to translate business milestones into an actionable technical roadmap, grounding technical debt reduction directly in business outcomes.
  • Author and embed standardized design templates into the software development lifecycle that leverage AI-assisted tools, driving 100% adoption across engineering pods and reducing cycle times by 35% or more.
  • Work closely with development, QA, and security teams to ensure architectural blueprints are highly practical, realistic, and friction-free for execution.
  • Design and implement LLM routing, caching, and model-governance architectures that optimize AI infrastructure costs to remain within 10% of the quarterly budget.

Requirements

  • 10 or more years of software engineering experience, including 4 or more years in a dedicated architecture or principal/staff engineer role.
  • Proven track record leading large-scale legacy modernization, including defining target-state architecture, sequencing domain decoupling, and executing migrations with zero unplanned downtime.
  • Demonstrated experience architecting production-level AI/ML systems, including LLM orchestration, agentic workflows, or intelligent automation at scale.
  • Deep expertise in modern distributed systems architecture, microservices, event-driven design, API gateway patterns, and cloud-native infrastructure.
  • Hands-on experience designing and governing AI/ML platform infrastructure, including LLM routing, prompt engineering patterns, vector databases, model evaluation frameworks, and cost optimization strategies.
  • Strong command of cloud infrastructure, CI/CD pipeline architecture, automated testing frameworks, and enterprise SaaS security and compliance requirements.
  • Experience partnering with VP and C-suite stakeholders to translate business strategy into technical roadmaps and smart investment decisions.

Skills and Knowledge

  • Familiarity with embedding AI-assisted development tooling into engineering standards and organization-wide development workflows.
  • Experience navigating architectural transformations, rapid scaling, or platform consolidation within high-growth or private equity-backed environments.
  • Knowledge of compliance, legal, or regulated industry SaaS products where data accuracy, auditability, and security are core platform requirements.


Compensation:

Compensation at the time of offer is based on factors such as skill set, experience, qualifications, and work location. Salary is one part of Harbor Compliance's total compensation package. Other benefits may include health benefits, flexible paid time off, parental leave, fertility and adoption assistance, 401(k), and educational reimbursement. Note that the salary range and benefits apply only to U.S.-based candidates.

Pay Transparency Policy Statement
Harbor Compliance will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by Harbor Compliance, or (c) consistent with Harbor Compliance's legal duty to furnish information.

Notice Regarding the Use of Selection Technology

Harbor Compliance uses third-party automated tools and skills assessments (such as Testlify and Rippling) to help evaluate job applications and streamline our hiring workflow. These tools assist our recruitment team in reviewing qualification trends and scheduling, but all final employment decisions are made solely by humans on our Talent Success team, and all tools are subject to human oversight.

Depending on your location, local laws may grant you specific disclosure rights or the option to request an alternative evaluation process. If you require a reasonable accommodation or wish to opt out of automated assessment steps due to regional regulations, please notify your recruiter. Opting out will not negatively impact your application.

Similar Jobs

More Jobs at Harbor Compliance

More Enterprise Technology Jobs

Find similar Software Architect jobs: