Senior, Data EngineerPOSITION SPECIFICATIONS: To be completed by Compensation: Date: Job Code: Title: Senior, Data Engineer
FLSA Status: Department: Job Family: Information Technology Reports To: (Title) Data Platform Lead
Pay Grade: Direct Reports: Survey Source: POSITION PURPOSE Provide a brief description as to the primary purpose of this job (no more than three to five sentences).
PRIMARY DUTIES / RESPONSIBILITIES List essential job functions; describe in terms of actions (verbs) and desired outcomes
in order of most important first.
To comply with regulations by the American with Disabilities Act (ADA), the duties in job descriptions must be essential to the job. To identify essential functions, focus on the purpose and the result of the duties rather than the manner in which they are performed. The following definition applies: job function is essential if removal of that function would fundamentally change the job.
- Develop and operate data management tools, monitoring data flows, data quality, data cleansing and data processing
- Create and document logical data integration strategies for data flows between disparate systems and the enterprise data warehouse/data lakes
- Collaborate with different stakeholders (engineers, data stewards) to collect required data from internal and external systems
- Work in an Agile environment that focuses on collaboration and teamwork
- Improve and extend existing data infrastructure services
- Monitor production job schedule and correct job failures in a timely manner
QUALIFICATIONS List the minimum requirements to be considered for this position. Technical Knowledge, Years of Related Experience, Certifications Required, Equipment and/or Systems Experience
Education / Experience / Background - MS degree in Computer Science or computer related field from an accredited institution.
- 5+ years hands proven experience as a Data Engineer or similar role.
- 5+ years of strong experience building, running and maintaining datalake(s) and warehouse(s) in a cloud environment.
Knowledge / Skills / Abilities - More than 4 years of experience developing with Python.
- 4+ years performing with production environments in a DevOps culture managing code composed of multi-developer teams, following industry best practices.
- 4+ years SQL development experience.
- Experience with data modeling
- 4+ years bash scripting experience.
- Strong experience with Git, CI/CD (preferably GitLab) and Docker.
- Experience deploying and running services in Cloud Big Data platforms such as BigQuery and Snowflake.
- Strong experience with GCP services.
- Experience designing and building data pipelines using tools like Apache Beam, CDAP (Data Fusion) or other ETLs.
- Knowledge with CDC design patterns and their challenges.
- Experience with DAG workflows orchestration such as Apache Airflow.
- Experience with NoSQL databases is a plus (i.e Firestore, MongoDB).
- Experience designing and developing APIs is a plus (i.e using FastAPI, Flask).
Abilities: - Being able to work in a large company with different stakeholders.
- Embrace mentorship through design sessions, code reviews, and community building.
- Take ownership and support solutions you develop.
- Value collaboration with other members of the team.
- Have a product mindset.
- Good communication.
Required Certification / Licenses / Training - (Nice to have) Google Cloud Data Engineer
PHYSICAL REQUIREMENTS / WORK ENVIRONMENT The physical demands and work environment described here are representative of those that an employee encounters while successfully performing the essential functions of the job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. Include possible work hazards and percent of travel required. Hybrid mode (2 days a week in the office)
