Senior AI Software Engineer (LLM / GenAI)

Purple Drive Technologies

• $120K — $160K *
Jersey City, NJ 07305In-Person
Finance & Insurance
5 - 7 years of experience
More than 3 months ago
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science or related field (Master's preferred)
  • 7+ years of software development experience
  • Strong backend/API development on cloud platforms (Azure preferred)
  • Expertise in writing complex SQL queries and designing schemas
  • Hands-on experience with LLMs and AI services
  • Proven delivery of production-grade AI features
  • Experience with C#/.NET, Python, Java, or similar frameworks

Responsibilities

  • Lead development of text-to-SQL agent for natural language querying
  • Design and structure AI data layer across SQL Server and modern platforms
  • Build AI integration patterns including prompt engineering and RAG
  • Implement AI guardrails for compliance in regulated environments
  • Develop backend services and APIs for AI functionalities
  • Deploy and manage services on Microsoft Azure
  • Mentor engineers and set engineering best practices

Benefits

  • Collaborative work environment
  • Opportunities for mentoring and leadership
  • Focus on innovative AI applications in financial services
  • Engagement in high-impact projects
  • Support for personal and professional development
Full Job Description
Role Description

  • Hiring a Senior AI Software Engineer to lead design and delivery of AI-powered applications
  • Part of the Platform Development team
  • Focus on bridging LLMs and real financial data through backend architecture
  • Build systems that make AI practical for financial advisors and clients
  • Primary focus:

    • Build and scale text-to-SQL agents
    • Develop conversational AI tools
  • Work within a data ecosystem including:

    • SQL Server
    • Microsoft Fabric
    • Databricks
  • Key responsibilities:

    • Architect database schemas
    • Validate AI-generated SQL queries
    • Build backend services connecting AI to financial data platforms
  • Core expectation:

    • AI generates SQL, but you must verify correctness and performance
  • High-impact role involving:

    • Mentoring engineers
    • Driving architecture decisions
    • Establishing engineering standards
    • Promoting a culture of experimentation and delivery
  • Ideal for candidates interested in applying AI to financial services problems
Responsibilities

  • Lead architecture and development of text-to-SQL agent for natural language querying
  • Architect AI data layer:

    • Design schemas
    • Structure data across SQL Server and modern platforms
    • Validate AI-generated SQL queries (accuracy & performance)
  • Build AI integration patterns:

    • Prompt engineering
    • Retrieval-Augmented Generation (RAG)
    • Function calling
    • Agent-based workflows
  • Implement AI guardrails for regulated environments
  • Design and develop backend services and APIs for AI features
  • Deploy and manage services on Microsoft Azure
  • Mentor engineers and enforce best practices
  • Drive engineering standards and technical direction
  • Collaborate with product, design, and data teams for end-to-end AI delivery
Qualifications & Skills

  • Bachelor's degree in Computer Science or related field (Master's preferred)
  • 7+ years of software development experience
  • Strong backend/API development on cloud platforms (Azure preferred)
  • Strong SQL expertise:

    • Writing complex queries
    • Designing schemas
    • Evaluating AI-generated SQL
  • Hands-on experience with LLMs and AI services
  • Proven delivery of production-grade AI features (not just POCs)
  • Backend technology experience:

    • C# / .NET
    • Python
    • Java
    • or similar frameworks
  • Experience with data platforms:

    • SQL Server
    • Microsoft Fabric
    • Databricks
    • or equivalents
  • Demonstrated ability to:

    • Mentor engineers
    • Lead technical initiatives
  • Experience in regulated industries (preferably financial services)
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at Purple Drive Technologies

  • Mechanical Engineer - Thermal
    $75K — $95K *
    Delaware, OH 43015 (Delaware County)
    3 weeks ago
    Technical Services
    In-Person
  • Data Modeler
    $90K — $120K *
    Wilmington, DE 19805 (New Castle County)
    Reposted 3 weeks ago
    Finance & Insurance
    In-Person
  • Front end developer
    $80K — $110K *
    Norfolk, VA 23503 (Norfolk City County)
    Reposted 3 weeks ago
    Information Technology
    In-Person
  • Data Modeler
    $100K — $130K *
    Los Angeles, CA 90011 (Los Angeles County)
    Reposted 4 weeks ago
    Finance & Insurance
    In-Person
  • Quality Engineer
    $80K — $110K *
    Irving, TX 75061 (Dallas County)
    4 weeks ago
    Information Technology
    In-Person

More Finance & Insurance Jobs

Find similar Senior AI Software Engineer (LLM / GenAI) jobs:

NationwideJersey City, NJ