Optimized Job TitleFull Stack Data Engineer Overview / Summary We are seeking a skilled Full Stack Data Engineer to support the development and maintenance of an Enterprise Data Platform. This role will focus on designing, building, and optimizing scalable data pipelines within a Google Cloud Platform (GCP) environment.
The position will work with GCP-native technologies including BigQuery, Dataflow, and Pub/Sub while supporting data governance, security, and performance optimization. The role also involves collaborating with teams and establishing data engineering best practices.
Key Responsibilities - Design, build, and optimize scalable data pipelines within a GCP environment.
- Develop and deploy cloud-based data platforms and data pipelines using GCP services such as BigQuery, Dataflow, and DataProc.
- Work with GCP-native technologies including BigQuery, Dataflow, and Pub/Sub.
- Support data governance, security, and optimal performance within the data platform.
- Apply Service-Oriented Architecture (SOA) and microservices within a cloud data platform.
- Work with relational databases such as PostgreSQL and MySQL, NoSQL databases, and columnar databases such as BigQuery.
- Apply data encryption and data masking techniques in cloud environments.
- Work with CI/CD pipelines, Infrastructure as Code (IaC) tools such as Terraform and Tekton, and other automation frameworks.
- Troubleshoot complex data platform and microservices issues.
- Monitor and optimize cost and compute resources for processes using GCP technologies such as BigQuery, Dataflow, Cloud Run, and DataProc.
- Collaborate with teams to establish best practices for data engineering.
- Support continuous learning and innovation within data engineering.
Required Qualifications - Bachelor's degree in Computer Science, Information Technology, Information Systems, Data Analytics, or a related field, or an equivalent combination of education and experience.
- 7+ years of Data Engineering work experience.
- 5-7 years of experience in Data Engineering or Software Engineering.
- At least 2 years of hands-on experience building and deploying cloud-based data platforms, with GCP preferred.
- Strong proficiency in SQL, Java, and Python.
- Practical experience designing and deploying cloud-based data pipelines using GCP services such as BigQuery, Dataflow, and DataProc.
- Understanding of Service-Oriented Architecture (SOA) and microservices and their application within a cloud data platform.
- Experience with relational databases, NoSQL databases, and columnar databases.
- Knowledge of data governance frameworks, data encryption, and data masking techniques in cloud environments.
- Familiarity with CI/CD pipelines, Infrastructure as Code (IaC) tools such as Terraform and Tekton, and other automation frameworks.
- Excellent analytical and problem-solving skills.
- Experience troubleshooting complex data platform and microservices issues.
- Experience monitoring and optimizing cost and compute resources for GCP processes.
- Passion for data, innovation, and continuous learning.
- Ability to work onsite four days per week in a hybrid work environment.
#LI-Hybrid #LI-KK1
