Senior Data Engineers

Compunnel

$120K — $145K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree or equivalent in a relevant discipline.
  • 8+ years of ETL experience using SQL Server Integration Services (SSIS).
  • 10 years of experience with T-SQL programming.
  • Strong proficiency with the Microsoft BI Stack, including SSIS, SSRS, and SSAS.
  • Strong hands-on experience with Google BigQuery.

Responsibilities

  • Design, build, deliver, and support enterprise data warehouse and ETL solutions.
  • Develop data ingestion pipelines to transfer data to GCP-based platforms.
  • Maintain ETL/ELT processes for structured and unstructured data managing.
  • Optimize batch and near real-time data pipelines using Python and cloud services.
  • Orchestrate data workflows with Apache Airflow and cloud services.

Benefits

  • Support for continuous learning and staying current with technology trends.
  • Opportunities to lead projects and act as an internal consultant.
  • Participate in a collaborative Agile environment.
  • Hands-on experience with diverse and modern data technologies.
Full Job Description
Job Summary

We are seeking a Senior Data Engineer to design, build, deliver, and support enterprise-class data-centric solutions that provide business value from corporate data assets. The role will focus on large-scale cloud modernization and data migration initiatives, including designing and developing ingestion and ETL/ELT pipelines that move data from on-premises environments into Google Cloud Platform (GCP) and BigQuery. The Senior Data Engineer will work across Microsoft SQL Server BI, Google BigQuery, Azure SQL, Data Management, BI/DW, and MDM technologies, with responsibility for both batch and real-time data processing and the raw/bronze data layer. The role requires strong technical leadership, communication, architecture, troubleshooting, and problem-solving skills, as well as the ability to recommend improvements and adopt emerging technologies.

Key Responsibilities
• Design, build, deliver, and support enterprise data warehouse, ETL, and data ingestion structures and solutions.
• Design and develop data ingestion pipelines to move data from on-premises systems to GCP-based data platforms.
• Build and maintain ETL/ELT processes that ingest structured and unstructured data into a centralized raw/bronze data layer.
• Develop and optimize batch and near real-time data pipelines using Python and cloud-native services.
• Implement and support real-time data ingestion using technologies such as Dataflow and Datastream.
• Orchestrate data workflows using Apache Airflow and cloud-based orchestration services.
• Work with data from SQL data warehouses, APIs, external data feeds, IBM iSeries/DB2 databases, Excel, and other file-based sources.
• Support data movement from on-premises environments into Azure SQL and GCP-based platforms, ultimately landing data in BigQuery.
• Develop and maintain automated file-handling and data integration processes using ETL tools, FTP, and other transfer mechanisms.
• Support CI/CD deployment processes for data engineering solutions.
• Provide L3 application and on-call support for data and integration solutions.
• Perform capacity, performance, troubleshooting, and root-cause analysis activities for data platforms and pipelines.
• Act as an internal consultant by providing architecture guidance, technical vision, problem anticipation, and solution recommendations.
• Provide subject matter expertise for data and analytics solutions and associated data assets.
• Collaborate with Product Management and business stakeholders to understand requirements and develop data-centric solutions.
• Collaborate with downstream teams responsible for data modeling, reporting, analytics, and data consumption.
• Recommend architectural improvements, automation opportunities, and data engineering best practices.
• Design and implement solutions to transform, cleanse, and provision corporate data assets in a governed, secure, and high-performance manner.
• Participate in and at times lead project teams within an Agile environment.
• Manage multiple initiatives concurrently, including application and on-call support, projects, functional requirements, system specifications, and subject matter expertise activities.
• Prepare clear and concise technical documentation for delivered solutions and processes and maintain associated knowledge-base content.
• Provide technical leadership and effectively communicate technical information to stakeholders and management.
• Stay current with technology trends and innovations in data warehousing, cloud data engineering, data management, big data, event-based analytics, and real-time data processing.
• Participate in ongoing data management maturation activities, including data quality and master data management initiatives.
• Provide subject matter expertise for data associated with gaming and hospitality systems.
• Support data preparation activities for data science, advanced analytics, and real-time data use cases.
• Participate in 24x7 on-call support as required.

Required Qualifications
• Bachelor's degree or equivalent in a relevant discipline.
• 8+ years of ETL experience using SQL Server Integration Services (SSIS), including SQL Server 2008 R2-2022 environments.
• 10 years of experience with T-SQL programming.
• Strong proficiency with the Microsoft BI Stack, including SSIS, SSRS, and SSAS.
• Strong SQL and data modeling fundamentals.
• Strong hands-on experience with Google BigQuery.
• Cloud Data Engineering experience with GCP and/or Azure.
• Proven experience supporting cloud data migration projects, preferably involving migration from on-premises environments to GCP.
• Strong experience with data ingestion, ETL/ELT development, and data integration.
• Advanced Python development skills.
• Experience with cloud-native data ingestion and orchestration technologies such as Dataflow, Datastream, Airflow, Azure Data Factory, AWS Glue, or comparable services.
• Experience building and supporting both batch and real-time data pipelines.
• Strong understanding of relational and dimensional database modeling.
• Experience with Google Cloud Platform, BigQuery, Azure SQL, and modern cloud data engineering practices.
• Experience with Apache Airflow and workflow orchestration.
• Experience with Pub/Sub, real-time eventing, and streaming technologies.
• Experience with Cloud Run or comparable cloud-native services.
• Experience working with APIs, external data feeds, and data integrations.
• Experience supporting data from diverse sources, including SQL databases, IBM iSeries/DB2, and file-based sources.
• Experience with CI/CD processes for data engineering solutions.
• Strong troubleshooting, analytical, problem-solving, and root-cause analysis skills.
• Strong understanding of data engineering best practices and modern data architectures.
• Strong organizational skills, attention to detail, customer service focus, and process orientation.
• Strong interpersonal, written, and verbal communication skills.
• Ability to work effectively with technical professionals, business users, stakeholders, and management.
• Ability and willingness to adopt new technologies and paradigms, including big data, event-based analytics, and real-time processing.
• Ability to adhere to established SOPs and methodologies while identifying opportunities for improvement.
• Must be able to obtain and maintain Nevada Gaming Control Board registration and any other certification or license required by applicable law or policy.
• Must be willing and capable of providing 24x7 on-call support.

Preferred Qualifications
• Experience with MySQL, Python, Java, or .NET development.
• Experience with C#, ASP.NET, scripting languages, or web site operations.
• Experience with Data Management concepts such as Data Quality and Master Data Management (MDM).
• Experience with data preparation for Data Science.
• Experience with Big Data and advanced analytics technologies.
• Experience with Hadoop, Hive, or similar big data technologies.
• Experience with Tableau, Spotfire, SAS, Cognos, or Microsoft BI analytics tools.
• Experience with Azure DevOps or TFS.
• Experience with Agile/Scrum methodologies.
• Experience with Databricks implementations or data platform modernization initiatives.
• Experience developing API integrations and managing data movement across systems.
• Consulting or partner experience supporting enterprise cloud transformation initiatives.
• Experience with gaming and hospitality data and technology environments.
• Strong understanding of how data technologies can be applied to enhance gaming and hospitality business operations.

Similar Jobs

More Jobs at Compunnel

More Information Technology Jobs

Find similar Senior Data Engineers jobs: