eBay

Sr. Data Engineer

eBay$110K — $130K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • B.Sc. or M.Sc. in Computer Science or equivalent experience.
  • 3+ years of professional experience in software design and development for data pipelines.
  • Proficiency in programming languages including Python, Java, and Scala.
  • Expertise in distributed processing frameworks such as Kafka, Spark, and Flink.
  • Hands-on experience with Databricks and AWS cloud environments.
  • Familiarity with data reliability tools like Monte Carlo or Great Expectations.
  • Solid understanding of distributed system design, relational databases, and NoSQL technologies.

Responsibilities

  • Design and develop robust, scalable real-time and batch data pipelines using Kafka, Spark, and Flink.
  • Build and manage complex workflow orchestrations with Airflow.
  • Implement and maintain automated data quality frameworks for high-fidelity data.
  • Leverage Databricks and AWS to develop cloud-native data solutions.
  • Own major data engineering projects from design to long-term support.
  • Collaborate across multi-functional teams to guide data-driven roadmap items.
  • Identify technical risks and propose solutions or architectural improvements.

Benefits

  • Opportunity to work with cutting-edge technologies.
  • Engage in projects that directly impact millions of users.
  • Access to continuous improvement initiatives for technology stack.
  • Advancing cloud-native solutions for development efficiency and performance.
  • Collaborative work environment across various fields like Data Science and Product.
Full Job Description
Role Overview

We are seeking a talented and passionate Data Engineer to join our team to architect, design, and develop innovative, high-performance, and scalable data pipelines. In this role, you will be at the core of eBay's data ecosystem, building the infrastructure that enables real-time insights and powers personalized experiences for millions of users. You will have the opportunity to work with cutting-edge technologies like Flink, Spark, and Databricks to handle massive volumes of data where performance, reliability, and accuracy are of utmost importance.
Primary Job Responsibilities
  • Pipeline Development: Design and develop robust, scalable real-time and batch data pipelines using Kafka, Spark, and Flink.
  • Data Orchestration: Build and manage complex workflow orchestrations using Airflow to ensure timely and reliable data processing.
  • Data Quality: Implement and maintain automated data quality frameworks using Monte Carlo or Great Expectations to ensure high-fidelity data across the platform.
  • Cloud Architecture: Leverage Databricks and AWS to build cloud-native data solutions that improve development efficiency and system performance.
  • Project Ownership: Own major data engineering projects from the design phase through coding, testing, deployment, and long-term support.
  • Collaboration: Work effectively across multi-functional teams, including Data Science, Product, and other engineering leads, to provide data-driven guidance on roadmap items.
  • Risk Mitigation: Identify technical risks, foresee scalability challenges, and proactively propose solutions or architectural improvements.
  • Technical Excellence: Advocate for continuous improvement of the technology stack and maintain detailed documentation for all systems and pipelines.
Job Requirements

Category

Requirements

Education

B.Sc. or M.Sc. in Computer Science, or equivalent professional experience.

Experience

3+ years of professional experience in software design and development, specifically in data pipelines and backend services.

Languages

Proficiency in Python, Java, and Scala, with a strong foundation in data structures and multithreading.

Data Tools

Expertise in distributed processing frameworks: Kafka, Spark, and Flink.

Platform

Hands-on experience with Databricks and AWS cloud environments.

Workflow & Quality

Experience with Airflow for orchestration and DBT for transformation.

Observability

Familiarity with data reliability tools such as Monte Carlo or Great Expectations.

Architecture

Solid understanding of distributed system design, relational databases, and NoSQL technologies.

Preferred Qualifications
  • Experience with Agile/Scrum methodologies and tools like JIRA.
  • Experience in the e-commerce or payments domain is a plus.
  • Proven track record of architecting common libraries and patterns used in large-scale applications.
  • Advanced knowledge of model-view-controller (MVC) and object-oriented design paradigms.


Additional Details

This job posting relates to an existing vacancy within eBay.

About eBay

As a leader in automotive ecommerce, eBay Motors brings you millions of potential customers. Our new simplified listing plans give you unmatched levels of customization and control. So whether you're listing twenty cars a month or an entire lot, you know you're getting the value that you deserve.

eBay Careers

Joining eBay’s dynamic team offers more than just job opportunities; it’s a chance to be part of a global marketplace that values innovation, leadership, and diversity. As a leader in online retail, eBay provides a platform where ambitions flourish and career growth is fostered through comprehensive diversity training and professional development. Work You’ll Do At eBay, we empower you to drive your career path forward with a range of employment options, from internships to full-time positions. Our culture thrives on innovation and the pursuit of excellence in the digital commerce landscape. By joining our team, you’ll collaborate with skilled professionals who are adept at blending technology and creativity to achieve high-impact results. Explore eBay’s Diverse Opportunities Whether you’re starting out with an internship or seeking a leadership role, eBay’s global presence offers vast opportunities for professional growth and networking. Our commitment to diversity and inclusive culture allows every team member to feel valued and motivated. Innovate and Lead At eBay, every position contributes to our mission of creating a more connected and seamless e-commerce experience. We encourage our team to lead projects that challenge the status quo and promote innovation. With eBay, you’re not just filling a role; you’re part of a pioneering company that’s continually reshaping the world of online retail. Benefits and Growth eBay is dedicated to the well-being and development of our employees. We offer competitive benefits, leadership training, and opportunities for career advancement. Investing in our team’s growth is paramount, as they are the driving force behind our success. Join Our Team Ready to take the next step in your career? Explore the job opportunities at eBay where your skills and creativity can shine. We are hiring individuals who are passionate, curious, and eager to drive change in the e-commerce industry. Stay Connected Keep up to date with the latest career tips, company news, and industry insights available through our eBay Careers Blog. Personalize your experience by subscribing to job alert emails that match your career interests and skills. Apply Now Start your journey with eBay today. Search open positions that align with your professional aspirations and submit your resume. Our interview process is designed to understand your capabilities and potential to grow with us. Join eBay and be part of a team that’s committed to creating impactful change in the marketplace. Discover the opportunities waiting for you at eBay – a place where your career can thrive in an environment of innovation and leadership.
Learn more about eBay
Size
10,800 employees
Market Cap
$21.7 billion
Industry
Net Income
$5.6 billion
Founded
1995
5 Year Trend
+2.3%
Revenue
$10.7 billion
NASDAQ

Similar Jobs

More Jobs at eBay

More Information Technology Jobs

Find similar Sr. Data Engineer jobs: