Client seeks a Data Engineer with some AI experience to support in building, optimizing, and maintaining data pipelines, AI solutions, and analytics platforms. The ideal candidate will have hands-on experience with modern data engineering tools, AI solutions, CI/CD, and version control, and will collaborate with cross-functional teams to deliver high-quality, scalable data solutions.
- AI experience with prompt engineering, machine learning, agentic AI and RAG concepts
- Design, develop, test and maintain data pipelines and ETL processes for ingesting, transforming, and loading data from diverse sources (SQL, R, Python).
- Build and optimize data architectures and models to support analytics, reporting, and operational needs.
- Implement and manage CI/CD pipelines for data engineering workflows using tools such Git.
- Develop and deploy cloud-based solutions leveraging Azure Functions, and containerization (Docker, Kubernetes).
- Collaborate with DBAs and application developers to design and integrate data models, stored procedures, and APIs.
- Ensure data quality and integrity through validation, monitoring, and logging.
- Manage multiple tasks effectively across competing priorities.
- Troubleshoot and resolve issues in production environments, ensuring high availability and reliability.
- Document data flows, processes, and technical solutions for knowledge sharing and compliance.
- Stay current with emerging technologies and best practices in data engineering, cloud, and DevOps.
What You Will Need:
- Must be able to OBTAIN and MAINTAIN a "PUBLIC TRUST".
- A bachelor's degree is required.
- FIVE (5) years of experience in data engineering, software development, or related roles.
- Experience with Co-Pilot and CodeX., and AI methods.
- Experience presenting status and work products.
- Experience in programming languages and technologies, including Java, Python, SQL, and PySpark, as well as API development (RESTful and SOAP).
- Experience designing and developing data pipelines and ETL processes.
- Extensive experience with relational and NoSQL databases, such as MySQL, PostgreSQL, SQL Server, and MongoDB, including stored procedure development.
- Experience working with Databricks.
- Experience with CI/CD tools and pipelines, such as GitHub.
- Experience operating in Agile development environments.
What Would Be Nice To Have:
- Experience supporting federal programs and/or large-scale data modernization projects.
- Familiarity with version control and collaboration tools, including Git, and Azure Dev Ops
- Ability to work independently in a fast-paced environment.
- Strong analytical and troubleshooting skills.
- Excellent verbal and written communication skills, with the ability to clearly communicate complex technical concepts to diverse audiences.
- Familiarity with containerization and orchestration technologies
- Familiarity with security best practices and compliance in federal environments.
- Experience with microservices, Spring Boot, and integration of AI/ML components.
- Previous consulting experience
