Senior Data Warehouse Engineer

2U, Inc   •  

New York, NY

Industry: Education


Not Specified years

Posted 187 days ago

This job is no longer available.

About The Role

We are looking for a collaborative and results-driven data engineer with experience in system management and monitoring within AWS infrastructure, automated testing and continuous deployment. Agile techniques like test driven development (TDD) is a plus.

Above all, you care about delivering quality software in a sustainable and timely manner and about software craftsmanship. You have experience in, and passion for, high-quality, maintainable code that confers low operating costs, high change velocity and is a point of professional pride for you and the team.

Responsibilities Include, But Are Not Limited To

You are a competent data engineer and a technical leader with the following competencies:

  • Strong database background:
    • Data Warehouse architecture and data modeling
    • Monitoring, administration and performance tuning of the database servers
    • Design and implementation of ETL data flows
    • Data governance and security
  • Writing maintainable high-performance code
  • Refactoring to keep code maintainable
  • Conducting exploratory and automated testing
  • Job scheduling and monitoring
  • Debugging complex problems under time constraints
  • Lead technical design of applications and participate in larger system design efforts
  • Providing technical guidance and mentoring more junior team-members
  • Stay current with the industry trends and best practices

You have experience in:

  • Collaborating with the stakeholders (product managers, business analysts, and data science teams) to define and refine requirements
  • Planning and estimating development tasks and short-term projects
  • Relating your project deliverables to products you are building and strategy behind them
  • Advocating for end user needs in software you are building

Over time, we expect engineers in this role to grow by learning and practicing the following skills:

  • Participating in application and system level technical design
  • Conducting technical interviews
  • Participating in planning staffing needs on your team
  • Metrics driven software development

This role reports to Director of Engineering for Data Systems team.

About The Team

The Data Systems team maintains and develops a reliable, well-supported, and frequently updated data lake comprising raw and processed data from 2U's platforms. We provide a curated set of standardized and consolidated data from all of 2U's programs, as well as financial data that can be used by the business to build mission critical reporting services. We also strive to provide generic facilities for product engineering teams to move data between systems. All our hardware infrastructure is in deployed on the Amazon Web Services cloud and we make extensive use of SAAS services like Salesforce, Segment, Streamsets and others.

We are motivated to build a team where members bring sound computer science fundamentals and a diverse set of skills and experiences to the table. We looking for experience and expertise in the following technologies:

  • T-SQL using Postgres and MS SQL
  • Python and Shell Scripting
  • AWS: Aurora, Redshift, Kinesis, CloudWatch
  • Big Data applications (Spark SQL, Apache Drill, AWS Athena) and Data Visualization tools (e.g. Tableau) are a plus