ECS

Sr. Databricks Consultant

ECS$175K — $250K *
US-AnywhereRemote in Virginia, US
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of hands-on Databricks experience in production environments.
  • Strong proficiency in Python and/or SQL.
  • Experience with Apache Spark for large-scale data processing.
  • Knowledge of data lakehouse architecture and best practices.
  • Understanding of data modeling, quality assurance, and performance tuning.
  • Familiarity with CI/CD pipelines and version control (Git).
  • Bachelor's degree in Computer Science or Information Security, or equivalent experience.

Responsibilities

  • Design, build, and maintain scalable ETL/ELT pipelines in Databricks.
  • Optimize workflows and clusters for enhanced performance and cost-effectiveness.
  • Integrate Databricks solutions with major cloud platforms (AWS, Azure, GCP).
  • Implement data governance, security, and compliance protocols.
  • Collaborate with data scientists and business stakeholders to provide actionable insights.
  • Troubleshoot infrastructure issues and support continuous improvement efforts.

Benefits

  • Active Secret Clearance required.
  • Opportunity to work with cutting-edge technologies in data analytics.
  • Remote work flexibility.
  • Collaboration with a variety of clients for landscape diversity.
  • Engagement in data-driven decision-making impacting real-world challenges.
Full Job Description
ECS is seeking a Sr. Databricks Consultant to work remotely. Please Note: This position is contingent upon additional funding.

We are seeking a skilled individual with deep experience in Databricks to join our team. The primary responsibility of this role is to consult with customers to design, optimize, and fine-tune their Databricks environments for advanced data analytics, machine learning, and AI-driven insights. Leveraging tools such as Delta Lake, MLflow, and Databricks Machine Learning, the Data Scientist will play a crucial role in enabling clients to maximize performance, scalability, and value from their data platforms.

This role will support ECS's Professional Services and Managed Cybersecurity Services programs, with a focus on Databricks solutions. You will specialize in data pipeline optimization, scalable model training, and advanced analytics on Databricks, offering you a unique opportunity to work with leading-edge technologies and collaborate with clients to deliver measurable improvements in data-driven decision-making. If you are passionate about applying data science techniques within the Databricks ecosystem to solve real-world challenges, we encourage you to apply.

Responsibilities
  • Design, build, and maintain scalable ETL/ELT pipelines in Databricks.
  • Optimize workflows and clusters for performance and cost efficiency.
  • Integrate Databricks with cloud platforms (AWS, Azure, or GCP).
  • Implement data governance, security, and compliance standards.
  • Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets and insights.
  • Troubleshoot issues and drive continuous improvement in data infrastructure.


Salary Range: $175,000 - $250,000

General Description of Benefits

  • Active Secret Clearance
  • Proven experience working with Databricks in production environments.
  • Strong proficiency in Python and/or SQL for data engineering.
  • Experience with Apache Spark for distributed data processing.
  • Knowledge of data lakehouse architecture and best practices.
  • Experience with cloud data platforms (AWS S3, Azure Data Lake, or GCP Storage).
  • Hands-on experience building and managing ETL/ELT pipelines.
  • Strong understanding of data modeling, data quality, and performance tuning.
  • Familiarity with CI/CD pipelines and version control (Git).
  • Ability to travel, as needed, to customer sites.
  • Must be a US Citizen per contract.
  • Bachelor's degree; preferably in Computer Science, Information Security, or a related field. Will consider experience in lieu of a degree.

About ECS

ECS is a leading provider of digital solutions and services to the federal government. The company was founded in 2001 by Roy Kapani and has since grown to become a trusted partner to a wide range of government agencies. ECS offers a broad range of services, including cloud computing, cybersecurity, and artificial intelligence. The company has been recognized for its innovative solutions and has won numerous awards, including the AWS Public Sector Partner of the Year award.
Learn more about ECS
Size
2,000 employees
Industry

Similar Jobs

More Jobs at ECS

More Information Technology Jobs

Find similar Sr. Databricks Consultant jobs: