Software Engineer -Gen AI Inferencing | BOFA | Onsite - (Dallas, Charlotte, New York)

Photon$44K — $154K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience in OOP using Python/Scala/Java, with expert-level development skills.
  • Proficiency in AI/ML lifecycle management and development.
  • Hands-on experience in MLOps, fine-tuning techniques, and inference frameworks.
  • Experience deploying models in production using vLLM/Triton Inference Server and automation.
  • Strong skills in continuous integration and continuous delivery (CI-CD) practices.
  • Experience maintaining large-scale Python/Unix-based systems.
  • Hands-on knowledge of the generative AI retrieval-augmented generation process.

Responsibilities

  • Code solutions and conduct unit tests according to acceptance criteria and compliance requirements.
  • Design and modify architecture components and application interfaces while ensuring architecture integrity.
  • Mentor team members on CI-CD practices and automation tool stacks.
  • Refine stories, define requirements, and estimate work for delivery.
  • Execute proof of concepts to mitigate risks or explore new ideas.
  • Automate manual release activities to streamline processes.
  • Design and maintain automated test suites for integration, regression, and performance testing.

Benefits

  • Medical, vision, and dental benefits.
  • 401(k) retirement plan.
  • Variable pay/incentives.
  • Paid time off and paid holidays for full-time employees.
Full Job Description
Job Description

"Required qualifications:
5+ years OOP in Python/Scala/Java programming experience with expert level development skills
Experience with AI/ML/GenAI Lifecycle Management and Development and its Ecosystem.
-Hands on experience building frameworks using MLOps, Fine - Tuning techniques, Inference Frameworks
-Experience with deploying models using vLLM/Triton Inference Server in containers in production with automation.
-Performs Continuous Integration and Continuous Development (CI-CD) activities.
Performance Tuning those models and deployment to provide higher throughput.
-Track record of maintaining large scale Python/Unix based systems.
-Hands on experience and knowledge generative AI RAG process for various use cases, including chunking, embedding, retrieval, reranking and summarization.
-Hands-on experience in application development in one or more areas MongoDB, Redis, Angular/React Frameworks, Containerization, Building API based application leveraging FAST API services, JWT Integration, API Gateway
Develop efficient utilities, automation frameworks, data science platforms that can be utilized across multiple Data Science teams for AI/ML and GenAI work.
Working in large sized teams that collaboratively develop on a shared multi-repo codebase using IDEs (e.g. VS Code rather than Jupyter Notebooks), Continuous Integration (CI), Continuous Deployment (CD) and Continuous Testing
Strong automation, scripting, and Python development skills. Hands-on DevOps experience with one or more of the following enterprise development tools: Version Control (GIT/Bitbucket), Build Orchestration (Jenkins), Code Quality (SonarQube and pytest Unit Testing), Artifact Management (Artifactory) and Deployment (Ansible)"

"Position Summary
- This position is focused on design, build, and operate of reusable toolkits for Gen AI RAG capabilities.
-This job is responsible for developing and delivering complex requirements to accomplish business goals. Key responsibilities of the job include ensuring that software is developed to meet functional, non-functional and compliance requirements, and solutions are well designed with maintainability/ease of integration and testing built-in from the outset. Job expectations include a strong knowledge of development and testing practices common to the industry and design and architectural patterns."

"Responsibilities:
Codes solutions and unit test to deliver a requirement/story per the defined acceptance criteria and compliance requirements
Designs, develops, and modifies architecture components, application interfaces, and solution enablers while ensuring principal architecture integrity is maintained
Mentors other software engineers and coach team on Continuous Integration and Continuous Development (CI-CD) practices and automating tool stack
Executes story refinement, definition of requirements, and estimating work necessary to realize a story through the delivery lifecycle
Performs spike/proof of concept as necessary to mitigate risk or implement new ideas
Automates manual release activities
Designs, develops, and maintains automated test suites (integration, regression, performance)
Utilizes multiple architectural components (across data, application, business) in design and development of client requirements
Manage multiple priorities, and simultaneously engage with multiple teams.
Participates in estimating work necessary to realize a story/requirement through the delivery lifecycle.
Be vocal and actively participate in all session with business stakeholders and agile teams.
Collaborate with product teams, data analysts and data scientists to design and build solutions."

"Desired Qualifications
Experience building & deploying Gen AI inferencing platform with open-source toolsets, building inferencing & servicing capabilities (AI Gateway, Policy store, Observability) for RAG/ MCP use cases etc.
Hands on experience on driving and maintaining a culture of quality, innovation, and experimentation.
Research on new tools and capabilities for better UI and UX for advanced analytics platform, quick prototype and demonstrate the features and capabilities, and participate on various user forums."

Compensation, Benefits and Duration

Minimum Compensation: USD 44,000
Maximum Compensation: USD 154,000
Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.
Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full-time employees.
This position is not available for independent contractors
No applications will be considered if received more than 120 days after the date of this post

About Photon

Photon Careers

Joining Photon presents an unparalleled opportunity to advance one's career with a leader in digital innovation. Photon is actively seeking talented individuals to join its diverse team of professionals, dedicated to reshaping industries through technology and creativity.

Explore Job Opportunities

Photon offers a variety of job opportunities that cater to a range of skills and interests. Each position at Photon is designed to challenge team members while providing meaningful pathways for professional and personal growth.

Experience the Culture and Benefits

Photon is committed to fostering a workplace culture that promotes diversity and inclusion. The company provides comprehensive benefits designed to support the health, well-being, and financial security of each team member. At Photon, every professional enjoys access to career development programs and diversity training, ensuring they are equipped for leadership roles in an evolving marketplace.

Engage in Professional Growth

Photon believes in the power of innovation and leadership to drive success. The company supports its team members with resources for continuous learning and growth, including advanced training sessions and leadership workshops. Networking within Photon’s industry-leading community allows for unparalleled career advancement and skill enhancement.

Internship Programs

For those beginning their professional journey, Photon offers internship programs that provide a robust foundation in digital solutions. Internships at Photon are characterized by immersive projects and hands-on learning, guided by experts in various fields. These programs are a gateway to full-time employment and a promising career path.

Join the Team

Photon is hiring! Explore open positions that match your skills and interests. Photon looks for passionate, curious, creative, and solution-driven team players. Whether you are starting your career or looking to make a significant impact in your professional journey, Photon has a place for you.

Prepare for Your Interview

Photon values a thorough selection process. Prospective team members are encouraged to prepare by understanding the company’s mission and values. Tailoring your resume to highlight relevant experience and skills will make a significant difference. Engage actively during your interview, demonstrating your knowledge and enthusiasm for the role you are applying for.

Stay Connected

Keep up to date with the latest from Photon by following the company’s career blog. Gain insights from insiders, learn about new job openings, and get tips on preparing your resume and acing your interview.

Career Development at Photon

Photon is dedicated to the professional development of its team members. The company offers various tools and resources, including career coaching and performance feedback, to help individuals reach their full potential. With Photon, career aspirations are nurtured, encouraging every team member to excel and innovate in their respective roles.

Networking and Career Opportunities

Photon encourages its team members to engage in networking within the company and the broader industry. These connections can lead to myriad opportunities, from collaborative projects to mentorship. Networking at Photon is not just about building professional relationships; it's about fostering a community of innovation and mutual growth.

Conclusion

Photon is not just a company; it is a community of driven professionals committed to making a difference. With a focus on innovation, leadership, and diversity, Photon offers a dynamic environment where ambitious individuals can thrive. Explore the possibilities and join Photon’s team of leaders, innovators, and visionaries.
Learn more about Photon

Similar Jobs

More Jobs at Photon

More Information Technology Jobs

Find similar Software Engineer -Gen AI Inferencing | BOFA | Onsite - (Dallas, Charlotte, New York) jobs: