Full-time employee - Sacramento
Salary: $135,000 - $145,000
Scope of Work:Capio Group is looking for an experienced Data Engineer/Lead Developer with a detailed knowledge and expertise to work as part of a team in assisting with maintaining, enhancing, and advancing client Investment Data Warehouse (IDW) architecture/platform, which is capable of Generative Business Intelligence (GenBI), and Artificial Intelligence, Machine Learning (AI/ML) for providing deeper insights, predictive analytics, and automated decision-making capabilities. Furthermore, it is expected to drastically accelerate the development and deployment of Investment-related BI or GenBI, AI/ML, or agentic AI use cases that are to be deployed onto the IDW residing within the AWS and Snowflake ecosystems. All work must adhere to client AI policies, technology governance, standards, and guidelines.
The scope of key responsibilities and activities for the Data Engineer/Lead Developer includes, but is not limited to, the following:
- Effectively apply User Interface (UI)/ User Experience (UX) design principles for designing and building analytics dashboards with technologies such as Chainlit, Streamlit, and React.
Create interactive reporting and storytelling based on data visualization best practices, and human- centered design. - Leverage Out-of-Box (OOB) services/functions/APIs (e.g., calling SNOWFLAKE.CORTEX functions via SQL or configuring AWS Bedrock Knowledge Bases) to accelerate the design and
implementation of use cases. - Build automated tests to ensure the platform's Text-to-SQL engine isn't hallucinating incorrect numbers.
- Perform continuous prompt engineering to guide and finetune the platform's system behavior.
- Execute statistical analysis, predictive analytics, optimization; conduct AI/ML model prototyping with ML frameworks such as TensorFlow, PyTorch, scikit-learn.
- Apply expertise in platform-specific semantic layers or dbt (Data Build Tool), advanced SQL and dimensional modeling (Star Schema), and cloud ML platforms (e.g., AWS SageMaker, Azure ML, GCP Vertex AI).
- Implement containerization and orchestration (Docker, Kubernetes).
Operate CI/CD pipelines for ML and data workflows, data integration, cleaning, and transformation processes. - Responsible for monitoring, tuning, and logging for AI/ML and GenBI solutions, Extract, Transform, Load (ETL)/ Extract, Load, Transform, (ELT) pipelines (e.g., Airflow, Matillion), cloud data warehouses & lakes (e.g., Snowflake, Redshift, BigQuery, Azure Synapse), and cloud infrastructure automation (e.g., Terraform, Ansible).
- Continuously enhance and verify that the entire IDW ecosystem/solution is cost-effective, secure, and scalable.
- Provide technical leadership, solution guidance to project teams in support of solution design and development, and act as a technical liaison among Investment stakeholders, technical developers, 3rd party vendor teams and tech support.
- Apply vast experience and multidisciplinary expertise in AI Infrastructure & Agentic Workflows/Orchestration, Generative AI Design Patterns, Cloud Strategy & FinOps, and Security & Compliance (AI Governance) to support key Investment's initiatives.
- Analyze solutions and technologies and make recommendations based on knowledge of client Investment Branch's current and future needs.
- Proactively monitor and assess strategic direction of solution vendors, technology and market trends, and determine their potential impact and value to the IDW; prepare presentations, documents, diagrams, models, and other artifacts as required to communicate analysis, recommendations, or designs
- Transfer of knowledge to appropriate client staff is required, along with any requested materials and content for transfer of knowledge.
Mandatory Experience:
- At least ten (10) years of experience in data/BI engineering or analytics.
- At least five (5) years of experience in leading a team (at least 3 members) to implement enterprise-level BI and/or large data warehouse solutions.
- At least five (5) years of experience working with AI/ML or GenAI technologies.
- At least two (2) proven deliveries of production-grade BI or data products (dashboards, data models, APIs).
- At least two (2) years of experience with ETL/ELT pipelines, data warehousing platforms such as Snowflake, Amazon Redshift, and orchestration tools (Airflow, dbt, etc.).
- At least two (2) years of experience using OpenAI APIs or similar LLM platforms, building natural language to SQL/query systems, designing prompt strategies for business insights and analytics, and prompt engineering to guide the platform's system behavior.
- At least two (2) years of experience in SQL (advanced joins, window functions, performance tuning), data modeling (star/snowflake schemas, semantic layers), and hands-on experience with at least one major BI tool such as Power BI, Tableau, Looker.
- At least two (2) years of experience leading a team of analysts and developers, as well as collaborating with stakeholders, to discover, document, and implement requirements and stakeholder requests for data warehouse or business intelligence projects.
- For each applicable project meeting the requirements, you must provide client/user reference contact information in the qualification form (a minimum of three(3) references total). Additionally, you must be prepared to submit completed reference forms upon request. Each reference must be a representative of the company for which the project was developed and must have served in a management or supervisory role.
Desirable Experience:
- Holding technical certifications in the areas of: A copy of the certification must be provided upon request. Certification is required and cannot be substituted with an experience.
• AWS certifications
• Snowflake certifications
• BI certifications (Power BI, Tableau)
• AI/ML or GenAI-related coursework or credentials - Have a bachelor's degree in computer science, computer engineering, or related fields from an accredited or government sanctioned college/university. A copy of the certification must be provided upon request and cannot be substituted with an experience.
- Must be able to adhere to the hybrid working model by working on-site 2 to 3 business days per week at the client headquarters in West Sacramento, CA.
