City Of New York

AI Project Lead

City Of New York$125K — $150K *
Legal & Accounting
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in computer science, engineering, or related field plus 4 years of relevant experience, or 8 years of applicable experience without a degree.
  • Experience in IT automation engineering and monitoring engineering.
  • Expertise in AI application development and management of infrastructure systems.
  • Proficient in Python and familiar with AI/ML tasks and architectures.
  • Demonstrated capacity for strategic planning and project management.

Responsibilities

  • Analyze and implement AI applications for enterprise infrastructure systems.
  • Design and maintain AI monitoring solutions.
  • Lead early-stage ideation sessions with stakeholders for AI project scoping.
  • Mitigate risks concerning data security and AI integrity during implementation.
  • Oversee training, upskilling, and mentoring of project teams.
  • Manage testing for both on-prem and cloud environments, especially with GPU infrastructure.
  • Communicate project plans and recommendations to executive stakeholders.

Benefits

  • Collaborative work environment with executive stakeholders and end-users.
  • Involvement in cutting-edge AI/ML projects within the justice system.
  • Opportunity for professional growth and skills development in AI.
  • Ability to make a meaningful impact in enhancing prosecutor workflows.
  • Access to industry developments and innovative technologies.
Full Job Description
KCDA's AI Project Lead will help scope, plan and deliver AI-enabled solutions to assist prosecutor workflows. The AI Project Lead will report to the Director of Application Development as part of the Application Development Team, and work collaboratively with Executive stakeholders and end-users to architect scalable AI/ML solutions. The AI Project Lead will act as a trusted advisor in responsibly building tools to serve the Office's core mission of seeking justice. In this role, the AI project lead will lead a team of developers to participate in early-stage ideation sessions, survey prosecutor defined use-cases, explore multiple solutions, build technology stacks, test and train products for viable outcomes, and deploy enterprise-wide solutions. A successful candidate must have technical skills required for AI application development, project management experience, and a demonstrated ability for strategic planning. Key responsibilities: -Analyze, design, implement, maintain, and support AI applications and monitoring solutions for enterprise infrastructure systems and platforms. -Knowledge of infrastructure for AI/ML related tasks (Cloud and on-prem) is required. -Technical competency in Python is required. -A successful candidate must be proficient with AI application architecture scoping and design, and proficiency with LLM fine tuning using frameworks such as HuggingFace, LoRA, or PEFT. -Account for and mitigate risks during design and implementation regarding data security, data integrity, and AI veracity; implement AI audit logging, explainability mechanisms, and human-in-the-loop workflows. -A successful candidate will have proficiency with implementing LLM guardrails including hallucination mitigation, PII detection and output validation. -Review and draft training and internal governance, ensuring compliance with agency standards, propose updates to agency standards in line with industry advancements. -Train, upskill, supervise, and mentor project teams. -Communicate with end-users, executive stakeholders and IT supervision regarding use cases, project plans, and recommendations. -Test local solutions; manage on-premises GPU infrastructure for AI inference and training. -Test cloud compute. Experience with Azure, AWS, and/or GCP is required. -Design and deploy retrieval-augmented generation (RAG) pipelines, test hybrid environments. -Oversee testing and reporting of quality assurance and quality control of AI use cases. -Oversee scale-up, training, and deployment. -Oversee Event Management, Patch Management, Release Management, Change Management development and processes. -Monitor industry developments, liaise with vendors regarding new products and technologies. Preferred Skills: -Experience managing on-premises GPU infrastructure for AI inference and training workloads. -User training experience. -Experience with implementing confidentiality, data security and data integrity protocols; familiarity with government or legal sector data governance requirements including data residency and PII handling. -Proficiency with the implementation, deployment, and integration of AI applications. -Experience with automated document processing or de-identification pipelines for sensitive information. -Experience with speech-to-text pipelines and multilingual NLP or translation workflows. -Experience with prompt engineering, retrieval-augmented generation, agent/tool-use frameworks, containerization and orchestration of AI workloads. -Experience with vector databases, including chunking strategies, embedding model selection, and hybrid search approaches; proficiency with embedding models and retrieval evaluation techniques. -Ability to benchmark and produce metrics on LLM performance, experience with ML experiment tracking, model versioning, and reproducibility practices. -Ability to effectively communicate AI planning with executive stakeholders. -Ability to train, upskill, and lead a team of developers. -Ability to provide technical guidance on internal AI policy. -Ability to assess and evaluate vendor-provided solutions. IT AUTOMATION AND MONITORING E - 95712 Qualifications 1. A baccalaureate degree in computer science, engineering or a related field from an accredited college and four years of satisfactory full-time experience related to IT automation engineering, monitoring engineering, management of infrastructure; or 2. Eight years of satisfactory full-time experience related to IT automation engineering, monitoring engineering, management of infrastructure; 3. Education and/or experience which is equivalent to "1" or "2" above. Additional Information

About City Of New York

The City of New York is the most iconic and dynamic city on the planet. With a population of more than 8.4 million people, New York is not only the largest city in the United States — it is the academic, cultural, commercial, and financial capital of the world. City government is filled with opportunities for talented individuals seeking to improve their communities and make a meaningful difference in the lives of their fellow New Yorkers. Every day, the City’s more than 300,000 employees improve infrastructure, provide vital social services, build technology, protect health and safety, and so much more.

City of New York Careers

There has never been a better time to explore the diverse job opportunities at the City of New York—the hub of professional growth and innovation in the public sector.

Work You’ll Do

Join the City of New York’s dynamic team to contribute to the community and enhance the city’s services across a broad spectrum of disciplines. The City of New York offers a unique opportunity to engage in meaningful work that impacts the lives of millions while navigating through a career filled with learning and growth. Transform the metropolitan landscape and enrich the lives of its residents with the best minds in public administration, urban planning, and community services. The City of New York stands at the forefront of urban management and innovation. Lead with a unique position in public service, at the intersection of technology, community needs, and sustainable development. Work alongside a diverse team of professionals dedicated to improving city operations and enhancing the quality of urban life. Collaborate with the largest network of public service experts in the nation, fostering leadership, diversity training, and professional development.

Introducing the City of New York Public Service Careers

The team is building a market-leading public service career path to help professionals master their roles and contribute effectively to the city’s development.

Do Innovative Work

Join a vast network of experts—dedicated professionals at the intersection of governance, community service, and urban innovation.

Drive Change in Public Service

Deliver targeted solutions and policies that enhance city living and maintain New York as a leading global city through a depth and breadth of expertise that’s second to none.

Be Part of a Great Team

Engage in a wide range of city projects utilizing cutting-edge technology and strategies, harnessing the unparalleled capabilities, scale, and collaborative spirit of a dedicated public service team.

Future-proof Your Career

Advance your career with limitless opportunities in the public sector, supported by unmatched training, development programs, and certification support.

Explore

From improving city infrastructure to enhancing public safety, the City of New York offers a platform for professionals to apply their skills, innovate, and lead.

The City of New York Public Service Initiative

The combined efforts of various departments help overcome urban challenges and lead transformation in city management. Professionals around the globe look to the City of New York for new strategies and solutions to drive significant change and growth in urban living. ## Stay Connected

Join the Team

Search open positions that match your skills and interests. The City of New York looks for passionate, curious, creative, and solution-driven team players. SEARCH CITY OF NEW YORK JOBS

Keep Up to Date

Stay ahead with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the people who serve here.

READ CAREERS BLOG

Job Alert Emails

Personalize your subscription to receive job alerts, latest news, and insider tips tailored to your preferences. Discover what exciting and rewarding opportunities await in the City of New York.
Learn more about City Of New York

Similar Jobs

More Jobs at City Of New York

More Legal & Accounting Jobs

Find similar AI Project Lead jobs: