We are seeking an experienced Data Engineer to play a pivotal role in the development and maintenance of our Enterprise Data Platform. In this role, you will be responsible for designing, building, and optimizing scalable data pipelines within our Google Cloud Platform (GCP) environment. You will work with GCP-native technologies such as BigQuery, Dataflow, and Pub/Sub, while ensuring data governance, security, and optimal performance.
Job Requirements
Details:
Skills Required- Cloud Architecture, GCP, Python
Experience Required- 7+ years of Data Engineering work experience
- Bachelor's degree in Computer Science, Information Technology, Information Systems, Data Analytics, or a related field, or an equivalent combination of education and experience.
- 5â€"7 years of experience in Data Engineering or Software Engineering, with at least 2 years of hands-on experience building and deploying cloud-based data platforms; GCP experience preferred.
- Strong proficiency in SQL, Java, and Python.
- Practical experience designing and deploying cloud-based data pipelines using GCP services such as BigQuery, Dataflow, and DataProc.
- Solid understanding of Service-Oriented Architecture (SOA) and microservices, including their application within a cloud data platform.
- Experience with relational databases, such as PostgreSQL and MySQL; NoSQL databases; and columnar databases, such as BigQuery.
- Knowledge of data governance frameworks, data encryption, and data masking techniques in cloud environments.
- Familiarity with CI/CD pipelines, Infrastructure as Code (IaC) tools such as Terraform and Tekton, and other automation frameworks.
- Experience monitoring and optimizing cost and compute resources for processes using GCP technologies such as BigQuery, Dataflow, Cloud Run, and DataProc.
Education Required#LI-PS11
#LI-ONSITE
Pay Range:
$ 61.00 - $ 66.00
