General Summary:We're looking for a Business Intelligence Analyst I - AI & Model Monitoring to help establish and scale a new model governance capability within our Finance Analytics organization. This is a unique opportunity to join at the ground level and play a critical role in designing how we monitor, measure, and communicate machine learning model performance across the business.
In this role, you'll develop monitoring frameworks, performance KPIs, dashboards, and automated alerting solutions that ensure AI and predictive models remain accurate, reliable, and effective in production. You'll partner closely with Data Scientists, Data Engineers, BI Analysts, Business Analysts, and business stakeholders to transform complex data signals into actionable insights and governance processes.
We're seeking a curious, analytical builder who enjoys solving complex problems and creating solutions from scratch. While prior governance experience is not required, success in this role requires strong critical thinking, ownership, learning agility, and communication skills. The ideal candidate is comfortable navigating ambiguity, collaborating across teams, and proactively driving work forward.
Python is the primary coding language for this team, making strong Python proficiency essential. Experience with Databricks, SQL, cloud-based analytics environments, and data visualization tools is highly valued.
If you're excited about AI, analytics, and building something new while working alongside a talented team of data professionals, we'd love to hear from you.
Job Specifications- Bachelor's degree preferred (Data Science, Statistics, Computer Science, Mathematics, or related field) and/or equivalent experience
- 2+ years of relevant analytics experience, with demonstrated ability to write and maintain Python code for data analysis and automation
- Proficiency in Python (required) - including libraries such as pandas, numpy, scipy, and visualization libraries (matplotlib, plotly, or similar)
- Proficiency in SQL for data extraction and validation
- Experience with or strong interest in Databricks (notebooks, jobs, Delta tables, Unity Catalog) - direct experience preferred but not required
- Familiarity with BI/visualization tools (Tableau, Power BI, or equivalent) for presenting monitoring outputs
Principal Duties and Responsibilities- Develop and automate monitoring dashboards and reports that surface model health metrics (e.g., accuracy degradation, input/output drift, data quality anomalies) for review by leadership and model owners
- Execute quantitative monitoring tests such as back-testing, benchmarking, sensitivity analysis, and statistical threshold checks on production model outputs as defined by the monitoring framework
- Profile and analyze incoming data sources to evaluate data quality, completeness, and suitability for ongoing model inference and monitoring
- Document monitoring methodologies, assumptions, and alert configurations to ensure reproducibility and auditability in alignment with enterprise model risk governance
- Track and report on monitoring findings, including drift alerts, performance degradation events, and data quality issues, escalating to the director/manager when intervention or model recalibration is warranted
- Work directly with model owners and internal customers to refine monitoring requirements, validate thresholds, and ensure outputs align with business expectations
#LI-AD1
#LI-HYBRID
~IN1
The base salary range for applicants for this position is listed below. Unless actual salary is indicated above in the job description, actual pay will be based on skill, geographical location and experience.
$60,500.00-$123,400.00
Additionally, Unum offers a portfolio of benefits and rewards that are competitive and comprehensive including healthcare benefits (health, vision, dental), insurance benefits (short & long-term disability), performance-based incentive plans, paid time off, and a 401(k) retirement plan with an employer match up to 5% and an additional 4.5% contribution whether you contribute to the plan or not. All benefits are subject to the terms and conditions of individual Plans.
