This is an AI-first engineering role. We expect you to leverage AI tools to design, build, and deliver solutions - the value you bring is knowing what to build, how to solve problems, and how to validate results.
As our Senior Data Engineer, you'll lead the design and development of scalable data pipelines and data products on our Azure-based platform, with Databricks at the core.
You'll build trusted, production-grade data that powers analytics, operational intelligence, and AI initiatives across the business.
What You'll Do
• Lead the design and development of scalable data pipelines in Databricks
• Build and optimize Lakehouse architecture using Medallion (Bronze/Silver/Gold) design
• Develop data solutions using Python, Pyspark, Spark SQL, and Delta Lake
• Integrate APIs, enterprise systems, SaaS platforms, and external data sources
• Establish data quality, testing, monitoring, and performance standards
• Mentor engineers and promote engineering best practices
• Drive CI/CD, automation, and AI-first development practices
• Partner with analytics engineers, data scientists, and application teams
• Evaluate new technologies through proof-of-concept projects
What You Bring
Required
• AI-first development mindset
• 5+ years of data engineering experience, including senior or lead responsibilities
• Expert Python and SQL skills
• Deep experience with Databricks, Apache Spark, and Pyspark
• Experience building production data pipelines
• Lakehouse architecture and Medallion modeling experience
• Data quality, testing, and monitoring expertise
• CI/CD and Git experience
• Experience with Azure Data Factory, Airflow, or similar orchestration tools
• REST API and enterprise system integrations
• Bachelor's degree in computer science, Engineering, Information Systems, or equivalent experience
• Strong communication and collaboration skills
Preferred
• Azure Databricks
• Azure Data Factory
• Azure Data Lake Storage
• Delta Lake
• Apache Airflow
• Databricks Asset Bundles
• Databricks Apps
• MLflow, Mosaic AI, Unity Catalog
• Experience supporting AI/ML workloads
• Databricks Data Engineer Certification
Work environment/physical demands summary:
This job operates in an office environment and uses a computer, telephone and other office equipment as needed to perform duties. The noise level in the work environment is typical of that of an office with an open seating floor plan. The employee may encounter frequent interruptions throughout the work day. The employee is regularly required to sit, talk, or hear.
#LI-SG1
#Remote
Benefits
For more information about our benefit offerings, please visit our careers page at https://www.echo.com/company/careers.
This role is eligible for a bonus that is based on a combination of personal and business performance.
