Platform Engineer - Cloud Data & MicroservicesOverview / Summary We are seeking a hands-on Platform Engineer with strong experience in Java or Python, cloud platforms, microservices, and data engineering. The engineer will design, develop, test, and release scalable data platform solutions using GCP, while working across data pipelines, APIs, full-stack integration, data governance, security, automation, and performance optimization.
Key Responsibilities - Design, develop, and maintain scalable data pipelines and microservices supporting real-time and batch processing on GCP.
- Design and implement Service-Oriented Architecture (SOA) and microservices-based solutions.
- Contribute to the integration of front-end and back-end components for data access and UI-driven data exploration.
- Lead data ingestion and integration from various sources into the data platform.
- Utilize GCP services such as BigQuery, Dataflow, Pub/Sub, and Cloud Functions to build and manage data platforms.
- Implement data governance, access controls, and security best practices, including GCP row-level and column-level security.
- Monitor and improve the performance, scalability, and efficiency of data pipelines and storage solutions.
- Collaborate with data architects, software engineers, and cross-functional teams to establish best practices, design patterns, and frameworks for cloud data engineering.
- Automate data platform processes to improve reliability, reduce manual intervention, and increase operational efficiency.
- Leverage AI to accelerate delivery and solve business problems at the platform level.
- Design and develop RESTful APIs for integration across platform services.
- Develop robust unit and functional tests while maintaining application quality and test coverage.
- Independently manage the software development lifecycle, including feature design, development, testing, and production releases.
- Troubleshoot and resolve complex data platform, microservices, and application issues.
- Use GitHub to manage code changes and troubleshoot and resolve application defects.
Required Qualifications - Bachelor's degree.
- Strong proficiency in Java, Angular, or other JavaScript technologies.
- Experience designing and deploying cloud-based data pipelines and microservices using GCP.
- Experience with GCP tools such as BigQuery, Dataflow, and Dataproc.
- Experience with modern data platform technologies such as Apache Beam and Kafka.
- Strong understanding of SOA and microservices architecture within cloud data platforms.
- Experience developing scalable services using Java/Spring Boot, Python, Angular, and GCP.
- Knowledge of front-end and back-end technologies, including React and Node.js.
- Experience designing and developing RESTful APIs.
- Experience with relational databases such as PostgreSQL and MySQL, NoSQL databases, and columnar databases such as BigQuery.
- Understanding of data governance frameworks and experience implementing RBAC, encryption, and data masking in cloud environments.
- Familiarity with CI/CD pipelines, Terraform/IaC, and automation frameworks.
- Experience with GitHub and source control.
- Understanding of software development lifecycle (SDLC) best practices.
- Strong analytical, problem-solving, and troubleshooting skills.
- Experience with microservices, web services, full-stack development, database design, GCP, data governance, information security, performance tuning, cross-functional collaboration, and automation.
Preferred Qualifications - Experience in reliability engineering.
- Master's degree.
- GCP Data Engineer certification.
- GCP Professional Cloud certification.
#LI-AA1
