Data Engineer

Houston Astros

$75K — $90K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • BS degree in Computer Science or a related field
  • 2+ years experience in data engineering and data operations/support roles
  • Experience with GCP or Azure in both on-premise and cloud environments
  • Technical skills in Python, dbt, SQL, T-SQL, and Linux
  • Experience extracting data from FTP and API data sources
  • Experience in building data structures and data pipelines in the cloud
  • Knowledge of big data frameworks and data orchestration tools

Responsibilities

  • Ensure optimal ingestion, processing, and distribution of production data
  • Onboard new datasets and technologies for use across the organization
  • Troubleshoot and resolve data ingestion and quality issues
  • Design, code, test, and roll out new datasets and enhance existing ones
  • Support analysts with the deployment and maintenance of predictive models
  • Build and manage Data Models and Data Catalog for efficient data discovery
  • Deploy data quality solutions for accurate and proactive monitoring of information

Benefits

  • Flexible schedule during baseball season for in-game support
  • Collaborative global team environment
  • Hands-on experience with diverse data applications and technologies
  • Opportunity to work in both sports and business analytics fields
  • Possibility for career growth within a professional sports organization
Full Job Description

Job Description:

Summary:

The New York Mets are seeking a Data Engineerfor itsData Engineering Technology team. Thisrole is a unique opportunity to work with data and systems insupport of operations inboth baseball and the business of baseball. It requireshands-onexperience in ingesting, processing,storing,optimizingand distributing structured and unstructured sources ofdatain areas as diverse as ticketing operations,business strategy,baseball analytics, performancetechnologyand other key areas. You will join a global team (NY and Poland) of data engineering professionalswhoprovideand supportbest in class end-to-end data and engineering servicesto Baseballand BusinessOperations, including but not limited to, Analytics and Systems teams. Prior experience in or knowledge of baseball is a plus but is notrequired.

Essential Duties & Responsibilities:

  • Ensure all production data sources are optimally ingested, processed, and distributed to applications, dashboards and users at set frequencies including real time in-game data

  • Onboard new datasets and technologies for use by analysts, data scientists,playersand other stakeholders throughout the organization

  • Troubleshoot, communicate,mitigateand solve any data ingestion and/or quality issues to all stakeholders

  • Design, code, test and roll out new datasets, as well as enhance and bug fix existing datasets

  • Support quantitative analysts in Baseball and Business Analytics with production deployments and maintenance of machine learning and other predictive models

  • Build and manage Data Model, DataDomainsand Data Catalog to keep data well-organized,accurateand curated for efficient data discovery

  • Deploy and manage data quality solutions (e.g.scalable framework,monitoringdashboard) to ensure accuracy, integrity, and proactive monitoring of information

  • Helpmaintaina data catalog for efficient data discovery

  • Actively collaborate with global team of Data Engineering/Support professionals on data engineering and support requests/issues

  • Able to work flexible schedule during the baseball season to ensure in-game support for users

  • Coordinate with IT and Infrastructure team to ensure a robust cloud development and production environment

Qualifications:

  • BS degree in Computer Science or a related field

  • 2+ years experience in data engineering and data operations/support roles

  • Comfort level with bothon-premiseand cloud (GCP or Azure experiencerequired) environments

  • Technical skills (Python,dbt, SQL, T-SQL, Linux) in working with ingesting, processing, and distributing large scale (both structured and unstructured) data sets

  • Experience extracting data from FTP and API data sources

  • Experience building data structures and data pipelines in the cloud, preferably Azure, Google Cloud Platform and on-prem

  • Experience in using modern Software Development Life Cycle (SDLC) and DevOps tools from development to productione.g.Terraform, Cloud Build,BitBucket

  • Ability to provide prompt support and resolution of data issues

  • Experience in implementing scalable data quality solutions

  • Knowledge of big data frameworks, database,orchestrationand other data tools, such as Google Cloud Composer (Airflow), GoogleBigQuery,MicorsoftSQL Server, Postgres, Google Dataflow, Google Pub/Sub,etc.

  • Ability to deliver superior customer experience through continuous process improvement

  • Strong analytical skills and ability to work well in a collaborative and fast paced environment

The above information is intended to describe the general nature, type, and level of work to be performed. The information is not intended to be an exhaustive or complete list of all responsibilities, duties, and skillsrequiredfor this position. Nothing in this job description restricts managements right to assign or reassign duties and responsibilities to this job at any time. The individual selected may perform other related duties as assigned orrequested.

 

SalaryRange:$75,000- $90,000

For technical reasons, we strongly advise to not use an .edu email address when applying. Thank you very much.

Similar Jobs

More Information Technology Jobs

Find similar Data Engineer jobs: