SUMMARY:
Reports to Manager, Data Architecture. The Data Engineer II is responsible for designing, building, and maintaining scalable, performant, and resilient data systems that will enable effective decision making and efficient business practices. Leads the operationalization of complex data pipelines, ensures data solutions align with business objectives. Mentors junior team members, increases organizational confidence in the validity of enterprise data sources, collaborates across departments, and leverages on premise and cloud-native technologies to deliver high performance data products. Streamlines data management processes, improving data quality, fostering collaboration, and providing a solid foundation for informed decision-making across the entire healthcare system.
RESPONSIBILITIES:
[redacted]Designs, builds, and maintains large-scale data processing systems, to ensure data pipelines are efficient, scalable, and secure. Works with multiple vendor supplied and home-grown data warehouses and lakes to reduce data duplication and inefficiencies. Performs advanced analysis of data sources to determine their value, recommends inclusion in analytical environments. Profiles and re-organizes existing data sources that may be complex and/or disjointed. Produces solid, well documented data infrastructure that can be used for years with minimal upkeep. Develops completely automated data validation and data mapping rules that validate regular data source updates, map new data values, and ensure that data values have not unexpectedly changed significantly. Ensures that data validation errors are quickly identified. Performs root cause analysis for any discrepancies or anomalies and implements corrective action. Integrates and ingests information from a diverse array of sources, including clinical data, inputs from suppliers, financial transactions, applications bolstering Human Resources (HR) and other services, third-party information, and even unstructured data from tools as ubiquitous as Excel spreadsheets and online forms. Innovates and leads the design and development of Extract, Transform, Load (ETL) processes. Evaluates and ensures the integrity of data movement, transformation code, and large datasets. Writes detailed documentation for data processes, tools, and pipelines with data users in mind. Contributes, maintains, and grows a unified data catalog and data model. Maintains a proactive engagement with organizational partners to ascertain and define new data requirements and terminologies as they emerge. Manages the mapping of common or related terms in a single, unified location. Monitors and adjusts mapping in this centralized space to improve coordination with operational partners. Proactively informs the data community about new developments and capabilities provided by the data architecture team. Designs, builds, and maintains a centralized repository of high-quality, reliable data, to streamline the workflow of data scientists enabling them to pivot from time-consuming tasks of building and validating datasets to the more sophisticated and impactful work of developing AI models. Mentors and guides junior engineers, fosters a culture of collaboration and continuous learning. Produces training materials on a variety of topics for use by data specialists across the organization. Contributes to cloud migration initiatives, data infrastructure modernization, and system optimization efforts. Monitors analytics department capacity resources such as Microsoft cloud computing capacity. Proactively develops and implements plans to reduce analytics department capacity usage without reducing data functions through optimization of processing techniques. Works in tandem with data governance bodies to advocate for safer, more secure, and more effective data procedures.
MINIMUM QUALIFICATIONS:
BASIC KNOWLEDGE: Bachelor's Degree in STEM-related field or equivalent. Epic Clarity Cogito certification preferred. Proficient in Structured Query Language (SQL), Python, and other data tools. EXPERIENCE / SKILLS: Experience: [redacted]Four years' experience in data engineering, with strong proficiency in SQL, Python, and other data tools. Experience with architecting scalable data systems and working with large, complex datasets. Experience designing and operationalizing complex solutions. Experience with data modeling, ETL processes, and data pipeline optimization. Firsthand experience with cloud platforms, data warehousing, and ETL design. Experience in healthcare data management and familiarity with healthcare industry standards is preferred. Demonstrated experience mentoring junior engineers and collaborating across teams. Skills: Strong analytical and critical thinking skills with an ability to decompose complex issues into practical solutions. Excellent written and verbal communication skills, with the ability to convey technical information to both technical and non-technical stakeholders. Skilled in rigorous and automated data validation techniques. Well versed in data documentation methods that prioritize a return on investment of documentation time. WORK ENVIRONMENT AND PHYSICAL REQUIREMENTS: Requires the visual and manual dexterity to operate a computer. This is a remote position with the option to travel to sites in Rhode Island and Southeastern Massachusetts, as needed. Employee will be responsible to establish a secure workspace environment to protect the confidentiality of sensitive information. Sensitive information includes confidential information, protected health information (PHI), and protected identifiable information (PII). Employee will be responsible for costs associated with setting up, furnishing, and managing their remote employee workspace and for costs of maintaining appropriate internet connectivity to access Brown University Health Information Services resources. INDEPENDENT ACTION: Performs independently within broad scope of department policies and practices. Refers specific complex problems to supervisor where clarification of departmental policies and procedures may be required. SUPERVISORY RESPONSIBILITY: None.
Pay Range:
$100,027.20-$165,048.00
Location:
Corporate Headquarters - 15 LaSalle Square Providence, Rhode Island 02903
Work Type:
M-F 8:30 am-5:00pm
Work Shift:
Day
Daily Hours:
8 hours
Driving Required:
No
