Job DescriptionThe Senior Data Engineer plays a pivotal role in building the centralized data platform and developing the enterprise data model. They lead the design, development, implementation and optimization of data pipelines and storage solutions, ensuring data is readily available for analysis and reporting. Senior Data Engineers evaluate and recommend new technologies, enforce data quality standards, and actively lead the technical aspect of cross-functional project planning. Their expertise in data engineering and architecture contributes to the establishment of a robust and scalable data infrastructure, supporting the organization's data-driven objectives.
ESSENTIAL FUNCTIONS: - Lead the design, architecture, and implementation of complex data pipelines and storage solutions
- Mentor teammates and peers providing technical guidance and expertise.
- Evaluate and recommend new data technologies and tools to improve efficiency.
- Collaborate with data scientists to optimize and scale machine learning workflows.
- Implement advanced data transformations and aggregation processes.
- Drive data engineering best practices and standards across the team.
- Actively participate in cross-functional project planning and execution.
- Manage and optimize cloud resources and costs related to data processing.
- Lead efforts to improve data quality, lineage, and metadata management.
- Collaborate with business stakeholders to understand and prioritize data needs for strategic initiatives.
JOB QUALIFICATION REQUIREMENTS:Knowledge/Experience: - 6+ years of relevant experience in data engineering or a related field
- Bachelor's degree in Computer Science, Software/Computer Engineering, Mathematics or related discipline, Master's or higher is a plus
- Advanced proficiency in Python and SQL, expert-level proficiency of alternative general programming languages considered
- Extensive experience with data orchestration tools like Prefect or Airflow
- Strong experience with data transformation and modeling tools like dbt and data warehouse technologies like Snowflake and BigQuery or data processing frameworks like Apache Spark
- Extensive experience with version control systems and CI/CD tools
- Hands on experience with one of the major cloud platforms required, Azure preferred
- Leadership skills for mentoring and guiding junior team members
- Problem-solving skills for complex data engineering challenges.
- Effective communication for collaborating with cross-functional teams
- Project management abilities for overseeing multiple data projects
Salary: $155,000 - $189,000 per year; in addition to base salary, a discretionary 13% annual bonus is provided.
The successful candidate's starting pay will be determined based on job-related skills, experience, and qualifications.
PHYSICAL AND VISUAL ACTIVITIES:Ability to hear and speak well enough to converse verbally over the phone and in-person (expressing or exchanging ideas by means of the spoken or written word). Ability to interpret, evaluate and communicate detailed written or verbal instructions to others accurately and easily. Able to see well enough to use the computer effectively and read written communications. Ability to lift, push, pull or carry up to 15 pounds for the dissemination of documents, supplies, materials, etc. to various locations throughout the office/facility. May be required to climb stairs depending on the property structure.
The above describes the physical and visual activities that are commonly associated with the performance of the essential functions of this job. "Commonly associated" is not intended to mean always or only. Reasonable accommodation will be provided as required by law to enable otherwise qualified employees with a known disability to perform the essential functions of the job.