Data Engineer

Bloomberg Industry Group

$110K — $130K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 3 years of experience in data engineering or related roles
  • Hands-on experience with Databricks is preferred
  • Proficiency in SQL for querying large datasets
  • Experience with Python for data processing
  • Understanding of ETL/ELT concepts
  • Familiarity with cloud platforms like Azure, AWS, or Google Cloud
  • Basic knowledge of data warehousing and dimensional modeling

Responsibilities

  • Design, develop, and maintain data pipelines using Databricks
  • Build and optimize ETL/ELT processes for data ingestion
  • Collaborate with stakeholders to understand data requirements
  • Monitor pipeline performance and troubleshoot issues
  • Develop and maintain data models and documentation
  • Support data governance and quality standards
  • Assist in managing cloud data infrastructure

Benefits

  • Opportunity for continuous learning and technology application
  • Chance to work in a collaborative environment with analysts and scientists
  • Engagement in best practices with code reviews
  • Involvement in data governance and security initiatives
Full Job Description

What You Will Do:

  • Design, develop, and maintain data pipelines using Databricks

  • Build and optimize ETL/ELT processes to ingest, transform, and load data from various source systems.

  • Collaborate with business analysts, data scientists, and stakeholders to understand data requirements and deliver reliable datasets.

  • Monitor data pipeline performance and troubleshoot data quality or processing issues.

  • Develop and maintain data models, documentation, and metadata.

  • Support the implementation of data governance, security, and data quality standards.

  • Assist in managing cloud-based data infrastructure and storage solutions.

  • Participate in code reviews and follow best practices for data engineering and software development.

  • Support reporting and analytics teams by creating and maintaining curated data assets.

  • Continuously learn and apply new technologies, tools, and methodologies within the data engineering ecosystem.

You'll Need to Have:

  • 3 years of experience in data engineering, data integration, or related technical roles.

  • Hands-on experience with Databricks preferred.

  • Proficiency in SQL and experience querying large datasets.

  • Experience with Python for data processing and automation.

  • Understanding of ETL/ELT concepts and data pipeline development.

  • Familiarity with cloud platforms such as Microsoft Azure, AWS, or Google Cloud.

  • Basic knowledge of data warehousing concepts and dimensional modeling.

Compensation Range:

$110,000.00-$130,000.00

Placement in the salary range will be decided upon completion of the interview process. Salary determination will be determined based on factors including but not limited to relevant experience, demonstrated skills related to the requirements of the role, education, certifications, and geographic location.


Similar Jobs

More Jobs at Bloomberg Industry Group

More Information Technology Jobs

Find similar Data Engineer jobs: