Software Engineer

EBSCO Industries, Inc.

$79K — $97K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of hands-on production experience with major LLM platforms, including optimization techniques for cost and latency.
  • Proficient in backend development using C#/.NET and/or Python.
  • Strong Azure expertise in App Service, Container Apps, Functions, Key Vault, and Managed Identity.
  • Experience with CI/CD tools such as GitHub Actions or Azure DevOps and infrastructure-as-code methodologies like Bicep or Terraform.
  • Demonstrated experience applying security best practices, particularly with OWASP guidelines for LLM and Agentic applications.
  • Expertise in GitHub workflows, including security-conscious practices such as branch protection and code scanning.
  • Familiarity with REST and OData APIs, focusing on least-privilege data access requirements.

Responsibilities

  • Design and develop production applications leveraging commercial LLMs, ensuring optimized tool use and cost management.
  • Architect and implement agentic workflows and secure integration with internal systems, focusing on data safety.
  • Deploy and manage Azure services, utilizing security features such as Key Vault and Managed Identity.
  • Establish and maintain CI/CD pipelines for code deployment, ensuring a secure and efficient workflow.
  • Provide observability for systems through structured logging and telemetry from initial deployment.
  • Create guidelines for human-in-the-loop interactions for critical processes, ensuring risk management.
  • Enforce security protocols in GitHub workflows through automated tools and practices.

Benefits

  • Opportunity to work with cutting-edge AI technologies and large language models.
  • Collaborative work environment focused on security-conscious engineering.
  • Access to continuous learning and development opportunities in AI and cloud-based services.
  • Potential for career growth within a rapidly evolving field.
  • Engagement with cross-functional teams and complex business systems.
Full Job Description
Job Summary

All Current - Software Engineer, AI Platform

Hands-on individual contributor

We're looking for a hands-on software engineer to design, build, and operate production applications and integrations powered by large language models (LLMs). You'll own the full lifecycle agentic architecture, integration design, secure deployment, and monitoring on Azure, and be the technical owner of how we build with LLMs: tool use, structured outputs, cost/latency tradeoffs, and increasingly multi-agent and Model Context Protocol (MCP)-based systems that connect models to our business systems.

This is a security-first role. You won't just ship features, you'll bring a rigorous, supply-chain-aware, secrets-free approach to how code gets from a laptop to production, and you'll treat every agent and integration as an identity with real permissions in a live environment.

Much of the interesting work is cross-system: safely exposing and combining data across multiple business systems while enforcing strict, least-privilege data segregation.

Job Responsibilities

  • Build production applications and integrations on commercial LLM platforms, tool/function calling, structured outputs, and prompt/context optimization for cost and latency. Help govern model selection, routing, and quota across the platforms we use.
  • Architect agentic workflows and MCP servers that connect models to internal systems through well-defined integration layers with security enforced at the integration boundary and centralized policy enforcement in front of downstream systems.
  • Deploy and operate services on Azure (App Service, Container Apps, Functions) using Key Vault and Managed Identity for secrets and identity. Treat every
  • Build and maintain CI/CD pipelines (GitHub Actions and/or Azure DevOps) using infrastructure-as-code (Bicep or Terraform) and OIDC-based deployment.
  • Instrument robust observability from day one: structured audit logging of agent decisions and tool calls, cost/token telemetry.
  • Design guardrails and human-in-the-loop escalation for high-impact or irreversible actions.
  • Maintain secure GitHub workflows: branch protection, code scanning, Dependabot, and least-privilege automation.
  • Apply a security-first mindset across the stack: OWASP Top 10, the OWASP Top 10 for LLM Applications (2025), the OWASP Top 10 for Agentic Applications (2026), and OWASP's MCP-server security guidance, plus SAST/DAST/SCA tooling and supply-chain hygiene (SLSA provenance, dependency integrity).
  • Continuously improve latency, cost, and reliability, including prompt caching and model-tier selection


Job Requirements

  • Hands-on production experience building on a major LLM platform (e.g., Anthropic Claude, OpenAI, Google Gemini, AWS Bedrock), including tool/function calling, structured output, and cost/latency optimization. This is non-negotiable.
  • Strong backend engineering skills: C#/.NET and/or Python preferred.
  • Strong working knowledge of Azure: App Service, Container Apps, Functions, Key Vault, Managed Identity, and foundational networking.
  • Practical CI/CD and infrastructure-as-code: GitHub Actions and/or Azure DevOps, Bicep or Terraform, and OIDC-based (secretless) deployment pipelines.
  • Fluency in GitHub as a security-conscious platform: Actions, branch protection, code scanning, Dependabot, and secure workflow design.
  • Demonstrated security-first engineering practices: secrets management, OWASP (including the LLM and Agentic Top 10s), SAST/DAST/SCA tooling, and supply-chain hygiene.
  • Comfort integrating with business systems over REST and OData-style APIs, and designing for least-privilege data access.


Essential Job Function

  • Experience building MCP servers, multi-step agentic architectures, and prompt-caching strategies.
  • Experience integrating with enterprise ERP systems and other systems of record.
  • Familiarity with SLSA provenance and supply-chain frameworks, and with NIST AI RMF (GenAI profile) alongside NIST 800-53, CIS Controls, and zero-trust principles.
  • Experience with enterprise SIEM and observability/monitoring stacks.
  • Relevant AI/LLM engineering certification (e.g., a vendor LLM-platform certification) a plus.

Similar Jobs

More Jobs at EBSCO Industries, Inc.

  • Project Manager
    $80K — $95K *
    Atlanta, GA 30349 (Fulton County)
    Real Estate & Construction
    In-Person
  • Senior Purchasing Agent-Circuit Breakers
    $80K — $100K *
    Moorestown, NJ 08057 (Burlington County)
    Manufacturing & Automotive
    In-Person
  • EBSCO Industries
    Paralegal
    $75K — $95K *
    Atlanta, GA 30349 (Fulton County)
    Legal & Accounting
    In-Person
  • Director of Cybersecurity
    $120K — $150K *
    Birmingham, AL 35242 (Shelby County)
    Information Technology
    In-Person
  • Data Scientist
    $90K — $120K *
    Birmingham, AL 35242 (Shelby County)
    Consumer Technology
    In-Person

More Information Technology Jobs

Find similar Software Engineer jobs: