Data Engineer

Broadway Direct

$90K — $130K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Strong proficiency in SQL and advanced data modeling (dimensional and canonical)
  • Experience with Python and tools like Fivetran and dbt for data pipelines
  • Deep experience with Snowflake or equivalent cloud data warehouses
  • Familiarity with CRM systems, preferably Salesforce
  • Experience managing data infrastructure in AWS or similar cloud environments
  • Understanding of ETL/ELT design patterns and APIs

Responsibilities

  • Design and operate scalable data pipelines across various systems
  • Standardize data ingestion from third-party platforms using modern tools
  • Manage reliable API and file-based ingestion systems
  • Own and optimize Snowflake data architecture and transformations
  • Establish data quality frameworks and monitoring tools
  • Develop Python workflows to automate processes and reduce manual interventions
  • Build data pipelines for core reporting and analytics

Benefits

  • Growth opportunities in data architecture and infrastructure
  • Impact on revenue through innovative pricing optimization systems
  • Exposure to advanced data stack tools and cloud technologies
Full Job Description
Duties and Responsibilities
Data Infrastructure & Pipeline Engineering
• Design, build, and operate scalable data pipelines across Salesforce, Snowflake, and external systems (ticketing, lottery, partners)
• Leverage Fivetran and API-based ingestion frameworks to standardize and automate data ingestion from third-party platforms
• Own API, webhook and file-based ingestion systems (SFTP, third-party feeds), ensuring reliability and observability
• Manage AWS infrastructure supporting data ingestion, processing, and orchestration

Data Warehouse & Modeling
• Own Snowflake data architecture, including schema design, transformations, and data modeling
• Develop and maintain transformation layers using dbt, including modular, testable, and well-documented models
• Build canonical datasets and dimensional models supporting analytics, CRM, ticketing, and pricing
• Optimize warehouse performance, cost, and scalability through clustering, partitioning, and query optimization
• Manage schema evolution and deprecation of legacy data structures

Data Quality, Governance & Reliability
• Establish data quality frameworks using dbt tests, monitoring tools, and pipeline validation checks to detect and resolve inconsistencies, duplication, and missing data
• Implement automated validation, monitoring, and alerting across pipelines
• Own data hygiene standards across customer, order, and transaction datasets

Automation & Systems Optimization
• Develop Python-based workflows to automate ingestion, transformation, and operational processes
• Reduce manual workflows through system design, tooling, and pipeline reliability improvements
• Leverage HighTouch to operationalize data by syncing curated datasets back into Salesforce and other business systems
• Partner with third-party developers to maintain ticket lottery systems
• Continuously improve pipeline performance, latency, and failure recovery

Reporting & Data Enablement
• Build and maintain data pipelines supporting core reporting (sales, marketing performance, partner reporting)
• Enable downstream analytics and BI through clean, accessible, and well-modeled datasets

Dynamic Pricing Data Infrastructure & Modeling Support
• Own the data infrastructure supporting dynamic pricing models
• Design and maintain model-ready datasets across pricing, inventory, and demand signals using Snowflake and dbt
• Partner with internal teams and external consultants to operationalize pricing models within Snowflake
• Enable rapid iteration, backtesting, and deployment of pricing strategies
QUALIFICATIONS
Expertise
• Strong proficiency in SQL and advanced data modeling (dimensional + canonical)
• Experience building and operating data pipelines using Python and modern data stack tools (Fivetran, dbt, HighTouch or similar)
• Deep experience with Snowflake or similar cloud data warehouses
• Experience working with CRM systems (Salesforce preferred)
• Experience managing data infrastructure in AWS or similar cloud environments
• Strong understanding of ETL/ELT design patterns, APIs, and distributed data systems

What Success Looks Like
• Reliable, scalable data pipelines with minimal manual intervention
• Improved data quality and reduced duplication/errors
• Faster reporting and improved data accessibility across teams
• Successful deployment and iteration of pricing models supported by robust data systems
Growth & Development Opportunities
• Opportunity to lead data architecture strategy, build scalable infrastructure, and directly impact revenue through pricing optimization systems.

Similar Jobs

More Jobs at Broadway Direct

  • Data Engineer
    $90K — $130K *
    New York, NY 10025 (New York County)
    Information Technology
    In-Person

More Information Technology Jobs

Find similar Data Engineer jobs: