Overview: The data engineer is responsible for designing, building, and maintaining robust data pipelines and models that support enterprise analytics and application development. This role requires a strong background in data integration, transformation, and quality assurance, ensuring that data is consistently reliable, accurate, and usable for business needs.
Responsibilities:
Specific duties include, but are not limited to, the following:
- Integrate data sets from various source systems into unified formats.
- Perform ELT (Extract, Load, Transform) operations to convert source data types into standardized target formats.
- Cleanse and transform data by applying business rules to ensure consistency and usability.
- Conduct data cleansing and validation to meet enterprise data quality standards.
- Monitor and troubleshoot data issues to maintain high reliability and accuracy.
- Create and maintain conceptual, logical, and physical data models.
- Ensure models align with business requirements and support analytics and application development.
- Build and maintain data pipelines that retrieve, standardize, and transform data from source systems.
- Load processed data into analytical data stores and prepare it for consumption by developers and analysts.
- Monitor the performance and quality of data transfers between source and target systems.
- Integrate test suites into CI/CD pipelines to ensure continuous validation of data pipelines
- Optimize data flows for efficiency, scalability, and reliability.
- Communicate well and work closely with team members including Analysts, Product Managers, and business users to gather requirements, troubleshoot, modify, and enhance existing Data assets.
- Develop backend applications in Database using TSQL/PLSQL in Microsoft SQL Server. Write complex code in stored procedures or PL SQL.
- Troubleshoot to find root cause with data accuracy and/or performance related issues and find solutions to fix it by creating indexes, transaction isolation levels and optimizing code.
- Resolve database performance issues by looking at query plans, create appropriate indexes, resolve dead locks and create table hints
- Ability to support the team in a high-volume environment to meet deadlines while maintaining exceptional attention to detail.
- Function as an expert and perform optimally within an agile development framework, properly creating or leading the team to create user stories and estimating effort and duration.
- Lead and manage end-to end life cycle to produce software and applications through project conception to completion.
- Adhere to all regulatory compliance training inclusive of BSA/AML/OFAC and overall BSA/AML/OFAC compliance.
- Participate in monthly on-call rotation.
- Perform other related duties as requested and special projects as assigned.
- Written and verbal communication skills.
- Ability to communicate with other members of the team.
- Highly Ethical.
Requirements:
- Bachelor's degree in information systems, Computer Science, Engineering, or related field, or the equivalent combination of education, training, and 6-8 years of experience
- Proficiency in SQL and data pipeline tools (e.g., Fabric, Azure Data Factory).
- Expertise in delivering and improving data quality in a Big Data environment in cloud for Enterprise Data Lake (Azure or similar), Data Warehouse (Azure Synapse or similar), and Data Hubs (Azure Cosmos DB or similar)
- Strong understanding of ETL processes and data warehousing concepts.
- Experience with DevOps toolset (Azure DevOps or similar) to collaborate and deploy code
- Experience in Test case design, execution, and defect tracking
- Familiarity with QA methodologies (e.g., Agile, Scrum)
- Excellent verbal and written communication skills, with the ability to effectively communicate complex concepts to stakeholders at all levels
- Experience with data modeling and metadata management.
- Familiarity with data quality frameworks and validation techniques.
- Ability to troubleshoot and resolve data-related issues quickly and effectively.
- Excellent communication and documentation skills to support cross-functional collaboration
- Expertise in .NET based architecture, including advanced concepts like enterprise application integration. Deep knowledge of C# and its application in building scalable, high-performance systems.
- Advanced skills in Microsoft SQL Server, including database optimization, performance tuning, and complex SSIS package development.
- Extensive experience with Reporting tools such Crystal Reports or SQL Reports.
- Familiarity with Symitar and its related technologies such as PowerOn, SymXchange, OpCon, and ARCU. This is a key differentiator for this role.
- Other: Desirable experience with SharePoint for collaborative products and workflows.
Why You'll Love Working Here:The pay range for this position is between $106,300-150,000 annually. Actual base pay offered may vary depending on a number of factors such as job-related knowledge, skills, experience, and location. Employees in this position may also be eligible for a discretionary bonus, 401(k) with an 6% employer match per pay period. Benefits for this position include Medical, vision, dental, life, and disability insurance, flexible paid time off and 11 paid holidays annually.
