Sr. Data Engineer/Lead (Remote)

Hudson Data LLC

$120K — $150K *
US-AnywhereRemote in Herndon, VA
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • BS in Computer Science, Engineering, or related field
  • 5+ years of production-grade coding experience in Python, Java, Scala, Kafka, or Spark
  • Proficiency with data build tools (DBT)
  • Experience in DevOps and shipping complex software to production
  • Strong understanding of data structures, algorithms, and performance optimization
  • Familiarity with ELT solutions in AWS (e.g., Athena, Glue)
  • Willingness to learn functional programming in Python/Java

Responsibilities

  • Integrate third-party APIs and understand various formats
  • Write and optimize production-grade code
  • Drive the implementation of ELT solutions on AWS
  • Utilize data build tools to streamline data workflows
  • Analyze and enhance system performance and scalability
  • Collaborate on high-scale distributed systems design
  • Implement fault-tolerant and secure data solutions

Benefits

  • Remote work flexibility
  • Long-term employment opportunity
  • Engagement with cutting-edge technologies
  • Opportunities for professional growth in data engineering
  • Involvement with healthcare data systems
Full Job Description
Job Title: Sr. Data Engineer
Location: Remote
Duration: Long Term

Description:
Required Qualifications:
BS in Computer Science or Engineering, or a related technical field
• Integrate third-party APIs, and the ability to understand them in several formats
• 5+ years of Expertise writing production grade code in Python, Kafka, Spark,
Scala and/or Java.
• Data build tools (DBT) have good experience.
• Coding experience in shipping/Devops complex software to production
• Expertise in data structures, algorithms, performance and scalability
• Knowledge of high-scale performance and optimization tools and techniques
• Desire to learn functional programming, specifically in Python/Java, as it is our
primary development language
• Able to drive ELT solutions across the AWS consumption Stack(Athena, Glue)

Preferred Qualifications:
• Experience with Kafka, Spark, Apache Airflow and Kubernates (Docker and containers)
• Understanding of fault-tolerant systems, network programming, multithreaded
programming, and security
• Experience with distributed systems and application design in a SOA environment
• Experience with AWS and/or Azure (configuring, deploying, managing) services and
distributed applications
• experience working with healthcare data (EMR Clinical data, Claims from variety of
payers, etc.)
• 3+ years of experience working with, analyzing, and understanding data using SQL
• Experience with Python a must
• Experience with Databricks a plus
• Experience with recommendations, predictions, personalization and machine learning,
A/B testing, Spark, Kafka, and MongoDB
• Experience with healthcare data experience (FHIR, Claims, Eligibility, RX)
• Experience with Python spark/Scala/Jav must
• Experience with Bigdata Solutions a must.

Similar Jobs

More Jobs at Hudson Data LLC

More Information Technology Jobs

Find similar Sr. Data Engineer/Lead (Remote) jobs: