Cloud Data DevOps Engineer
What You'll Do- Design, deploy, and maintain scalable and reliable cloud infrastructure on AWS and GCP.
- Build scalability, fault-tolerance, security, and performance into our data platforms to meet our growing data & analytics needs.
- Develop cloud data ingestion and processing frameworks.
- Automate routine tasks to improve efficiency and reduce manual intervention.
- Implement and maintain CI/CD pipelines for data applications.
- Optimize data pipelines and processes for performance and scalability.
- Troubleshoot and resolve issues related to data pipelines and data processing.
- Work with our data engineering teams, data science teams, and analytical business users to review and ensure best practices are followed and high-quality code gets implemented.
- Partner with our Information Security, Application Security, and Cloud Infrastructure Services teams to ensure data is secure both at-rest and in-flight.
- Ensure data platforms remain current to take advantage of the latest features and support.
- Mentor, teach, champion, and encourage an Automation mindset amongst the IT department and other business units.
- Communicate the status of assigned work to management and follow agile practices, standard procedures, and policies.
- Seek guidance when direction is needed and speak up about technology risks identified.
What You'll Need - Extensive hands-on expertise in Automation, troubleshooting logs, and optimizing system performance.
- Deep understanding of Cloud and data security in AWS or Google Cloud.
- Good experience with networking, Linux and Unix OS, and shell scripting.
- Demonstrated aptitude for identifying the underlying issues in Cloud services such as Glue, Lambda, Big Query, and Cloud Functions.
- Good experience with Cloud platforms AWS and/or Google Cloud in supporting Data pipelines and integrations.
- Experience with Cloud Automations using CloudFormation or Terraform.
- Good understanding of network infrastructures and protocols such as TCP/IP, TLS.
- Familiarity with data integration from different sources into Big Data systems is preferable.
- Familiarity with SQL and programming languages such as Python, Spark, YAML, and Bash.
- Cloud Certification in DevOps in AWS or Google Cloud is a plus.
#LI-LD1
Remarkable benefits:• Health coverage for medical, dental, vision
• 401(K) saving plans with company match AND Pension
• Tuition assistance
• Floating holidays and PTO for community volunteer programs
• Paid parental leave
• Wellness programs
• Employee discounts (membership, insurance,
travel, entertainment, services and more!)
