Sr Data Engineer (Databricks)

Qode

$130K — $150K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • BS in Computer Science or related field, or equivalent technical skills
  • 8+ years in software and data solutions for enterprise environments
  • Proficiency in Azure Databricks, Azure Synapse, Azure Data Factory, and related Azure technologies
  • Familiarity with infrastructure automation, particularly Terraform
  • Experience in application development using SQL, Azure, C#, and Python
  • Knowledge of Machine Learning and MLOps
  • Experience in investment management systems and Agile methodologies.

Responsibilities

  • Collaborate with business and technology partners to align data solutions with goals
  • Evaluate requests for architectural fit within the data warehouse
  • Oversee implementation and ongoing operations of Azure data solutions
  • Design and develop coordinated cloud data projects across various teams
  • Guide database and application development teams technically
  • Develop cloud security policies and best practices for data management
  • Troubleshoot and maintain the data warehouse and BI platform
  • Monitor application logs for system optimization and improvement
  • Conduct capacity planning and cloud cost optimization
  • Provide after-hours support for systems and applications
  • Develop project work plans and provide regular updates to management.

Benefits

  • Flexible work schedule after initial on-site period
  • Opportunities for professional development and growth
  • Access to advanced data technologies
  • Collaborative work environment with cross-functional teams
  • Participation in innovative data and cloud projects.
Full Job Description
Client: Wealth Management

Position: Sr Data Engineer (Databricks)

Compensation: $130K - $150K + Bonus

Location: First 90 days on site and then 1 day a week WFH either in Camas, WA or Plano, TX

Work Authorization: USC or GC ONLY

Education: BS or equivalent in Computer Science or related field or a combination of technical skills, cloud, operating system, networking, security, data application, data modeling and BI background

Experience:
  • Minimum of 8 years of experience developing software and data solution for enterprise environment focusing on data and cloud applications with direct experience with application development, data warehouse and BI design, implementation, and operation
  • Experience with cloud data warehouse and analytics technologies, specifically Azure Databricks, Azure Synapse, Azure Data Factory, Azure Data Lake Storage, Power BI, and other Azure data solutions
  • Knowledge or experience with infrastructure (operating system and networking) and cloud administration and automation such as Terraform for Infrastructure as Code.
  • Knowledge of DevOps in application development such as GitHub Actions, or Powershell
  • Experience with application development using Microsoft or cloud technologies (such as SQL, Azure, C#, Python)
  • Experience with Machine Learning, MLOps
  • Experience with investment management systems and processes
  • Experience with Agile methodologies in a cloud, application, database, data warehousing and BI space


Responsibilities:
  • Work with business and technology partners to analyze how the data warehouse, analytics and application will meet our goals
  • Evaluate all proposed requests to determine fit with data warehouse, analytics and application solution architecture.
  • Own data warehouse and analytics technical platform on Azure, from implementation to enhancements and ongoing operations
  • Design, develop and coordinate cloud data and application solutions/projects across diverse groups and areas including enterprise architecture, application development, identity and access management, network and data management
  • Provide technical direction and guidance to database and application developers
  • Develop cloud security and access control solution/policy, data and BI standards, guidelines and best practice for business groups and technical teams
  • Perform maintenance and troubleshooting activities for data warehouse, BI platform and other data projects and resolve issues
  • Monitor system application logs and identify potential issues and improvements to ensure smooth operations
  • Perform capacity planning, cloud cost analysis and optimization and provide recommendations to management
  • Provide after-hour system and application support
  • Develop multiple work plans for projects and prepare appropriate status reports and submit them to management

Similar Jobs

More Jobs at Qode

More Information Technology Jobs

Find similar Sr Data Engineer (Databricks) jobs: