Sr. Data Engineer/Lead (Remote)

Hudson Data LLC

$120K — $150K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • BS in Computer Science, Engineering, or related field
  • 5+ years' experience writing production-grade code in Python, Kafka, Spark, Scala, and/or Java
  • Strong knowledge of data build tools (DBT)
  • Experience with DevOps and shipping complex software to production
  • Expertise in data structures, algorithms, performance, and scalability
  • Familiarity with high-scale performance optimization tools
  • Willingness to learn functional programming, particularly in Python/Java
  • Ability to drive ELT solutions using AWS services like Athena and Glue

Responsibilities

  • Integrate third-party APIs effectively
  • Develop high-quality data solutions using Python and other languages
  • Optimize data pipelines for performance and scalability
  • Implement DBT for data transformation and management
  • Create and maintain reliable ELT processes across AWS services
  • Collaborate with cross-functional teams to enhance data workflows
  • Drive improvements in system reliability and fault tolerance

Benefits

  • Remote work flexibility
  • Long-term contract opportunity
  • Collaborative and innovative work environment
  • Access to cutting-edge technology and tools
  • Opportunities for professional learning and growth
Full Job Description
Job Title: Sr. Data Engineer
Location: Remote
Duration: Long Term

Description:
Required Qualifications:
BS in Computer Science or Engineering, or a related technical field
• Integrate third-party APIs, and the ability to understand them in several formats
• 5+ years of Expertise writing production grade code in Python, Kafka, Spark,
Scala and/or Java.
• Data build tools (DBT) have good experience.
• Coding experience in shipping/Devops complex software to production
• Expertise in data structures, algorithms, performance and scalability
• Knowledge of high-scale performance and optimization tools and techniques
• Desire to learn functional programming, specifically in Python/Java, as it is our
primary development language
• Able to drive ELT solutions across the AWS consumption Stack(Athena, Glue)

Preferred Qualifications:
• Experience with Kafka, Spark, Apache Airflow and Kubernates (Docker and containers)
• Understanding of fault-tolerant systems, network programming, multithreaded
programming, and security
• Experience with distributed systems and application design in a SOA environment
• Experience with AWS and/or Azure (configuring, deploying, managing) services and
distributed applications
• experience working with healthcare data (EMR Clinical data, Claims from variety of
payers, etc.)
• 3+ years of experience working with, analyzing, and understanding data using SQL
• Experience with Python a must
• Experience with Databricks a plus
• Experience with recommendations, predictions, personalization and machine learning,
A/B testing, Spark, Kafka, and MongoDB
• Experience with healthcare data experience (FHIR, Claims, Eligibility, RX)
• Experience with Python spark/Scala/Jav must
• Experience with Bigdata Solutions a must.

Similar Jobs

More Jobs at Hudson Data LLC

More Information Technology Jobs

Find similar Sr. Data Engineer/Lead (Remote) jobs: