Washington Post

Senior Data Engineer

Washington Post$119K — $199K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science, Software Engineering, or a related field; Master's preferred.
  • 3+ years of experience in ETL/ELT, data modeling, and large dataset analysis using SQL.
  • Extensive ETL development experience using Python and PySpark.
  • Strong proficiency with AWS services for building and deploying cloud-based applications.
  • Proven experience mentoring junior engineers and excellent communication skills.

Responsibilities

  • Lead data engineering efforts with Python, Spark, and Flink for scalable data pipelines.
  • Collaborate on project requirements and define technical solutions with cross-functional teams.
  • Write maintainable code following best practices in version control and testing.
  • Communicate technical solutions to stakeholders and collaborate with teams.
  • Mentor junior engineers, providing technical guidance and code reviews.
  • Manage project timelines, identifying risks to ensure timely delivery.
  • Stay current with industry trends to suggest improvements in performance and security.

Benefits

  • Competitive medical, dental, and vision coverage
  • Company-paid pension and 401(k) match
  • Three weeks of vacation and up to three weeks of paid sick leave
  • Nine paid holidays and two personal days
  • 20 weeks paid parental leave for any new parent
  • Robust mental health resources
  • Backup care and caregiver concierge services
  • Gender affirming services
  • Pet insurance
  • Free Post digital subscription
Full Job Description
We are seeking a skilled and experienced Senior Data Engineer for our Data and AI team to contribute to the development of innovative AI-powered projects at The Washington Post. As a key member of our team, you will be responsible for designing, building, and deploying data solutions that power cutting-edge AI technologies, including Generative AI, personalization, and recommendation systems, as well as revenue science applications. Your work will also support advertising insights generation and campaign infrastructure. This role involves gathering requirements, writing code, testing, deploying, and maintaining software using best practices in development. The engineer will work collaboratively on large-scale projects, contribute to the creation of new features, products, and tools, and mentor junior developers.

What Motivates You
  • You are passionate about solving complex technical challenges and driving impactful projects that shape the user experience for a news media platform.
  • You'll thrive in our team if you're a natural problem-solver, a strong communicator, and a proactive and curious individual who is always looking to learn and grow.
  • You'll be motivated by the opportunity to tackle complex technical challenges, lead and influence a team, and collaborate with cross-functional teams to drive user-focused solutions.
  • You'll also have the freedom to explore emerging technologies and trends, and to identify new opportunities for growth and innovation.
  • You're passionate about delivering high-quality solutions that meet the needs of our users.


How You'll Support the Mission
  • Technical Leadership: Lead data engineering efforts using Python, Spark, Flink and other data processing technologies, delivering scalable, secure, and reliable data pipelines, and contribute to the architecture and decision-making processes of large, complex projects.
  • Project Planning and Execution: Collaborate on gathering and analyzing project requirements to define technical solutions, and work with cross-functional teams to integrate front-end and back-end solutions, ensuring seamless user experiences.
  • Software Development: Write clear, maintainable code, following best practices in version control, code reviews, and testing, and ensure that all software solutions are scalable, secure, and meet the needs of our users.
  • Collaboration and Communication: Collaborate with cross-functional teams, including data scientists, product managers, and designers, to identify and prioritize project requirements, and communicate technical solutions to stakeholders.
  • Mentorship and Coaching: Mentor and coach junior engineers, offering technical guidance and reviewing code to ensure quality, and contribute to the growth and development of our engineering team.
  • Project Management: Collaborate with Product, Design, Newsroom and business stakeholders to manage and optimize project timelines, proactively identifying blockers and risks to ensure timely delivery.
  • Technical Expertise: Stay current with industry trends, suggesting improvements to enhance performance, security, and scalability, and apply knowledge of data engineering to drive innovation and improvement in our products and services.
  • Documentation and Knowledge Sharing: Contribute to the development of technical documentation and design specifications for team members and share knowledge and expertise with the team to promote a culture of innovation and collaboration.


The Skills and Experience You Bring
  • Education and Experience: Bachelor's degree in Computer Science, Software Engineering, or a related field is acceptable, but a Master's degree is preferred. Equivalent professional experience will also be considered. 3+ years of overall experience in ETL/ELT, Data modeling, and querying and analyzing large datasets using SQL.
  • Technical Skills: Extensive experience with ETL development using Python and PySpark. Experience with AWS Data Lakehouse technologies including Redshift, Athena, EMR, and Glue catalog. Strong understanding of Pub/Sub and event-driven architecture. Able to design and deploy DAGs using Apache Airflow. Experience with Apache Iceberg, Postgres, MySQL, DynamoDB, Tableau, and Superset also highly preferred. Experience working with Google Ad Manager data and Ad Tech vendors is a plus.
  • Cloud Infrastructure: Strong proficiency with cloud infrastructure, including experience with AWS services (e.g., EC2, S3, RDS, Lambda, Batch) for building and deploying scalable, reliable, cloud-based applications. Strong skills with Docker and ECS are highly preferred.
  • Software Development: Experience with software development best practices, including coding standards, code reviews, testing, and CI/CD pipelines.
  • Performance Monitoring: Experience with performance monitoring and observability tools (e.g., Splunk, Datadog) for maintaining application health and performance.
  • Leadership and Communication: Proven ability to mentor junior engineers, influence team-wide practices, and communicate technical concepts to both technical and non-technical stakeholders.
  • Problem-Solving: Excellent problem-solving skills, with the ability to troubleshoot and debug issues across the stack.
  • Autonomy and Decision-Making: Ability to handle complex projects with limited supervision and manage technical decision-making.

Collaboration makes us stronger. That's why our offices are designed with open layouts, modern technology, and easy access to transportation. With certain exceptions for newsgathering and business travel, we work on-site five days a week.

Compensation and Benefits

Wherever you are in your life or career, The Washington Post offers comprehensive and inclusive benefits for every step of your journey:
  • Competitive medical, dental and vision coverage
  • Company-paid pension and 401(k) match
  • Three weeks of vacation and up to three weeks of paid sick leave
  • Nine paid holidays and two personal days
  • 20 weeks paid parental leave for any new parent
  • Robust mental health resources
  • Backup care and caregiver concierge services
  • Gender affirming services
  • Pet insurance
  • Free Post digital subscription
  • Leadership and career development programs


Benefits may vary based on the job, full-time or part-time schedule, location, and collectively bargained status.

The salary range for this position is:
$119,700 - $199,300 Annual

The actual salary within this range will depend on individual skills, experience, and qualifications as they relate to specific job requirements. This position may be eligible for a bonus or incentive program, and a member of the Talent Acquisition team will discuss bonus payment terms and conditions during the interview process.

About Washington Post

The Washington Post is an American daily newspaper published in Washington, D.C. It is the most-widely circulated newspaper within the Washington metropolitan area and has a large international audience. Daily broadsheet editions are printed for D.C., Maryland, and Virginia. The newspaper has won the Pulitzer Prize 65 times for its work, the second-most of any publication. It is considered a newspaper of record in the U.S. Post journalists have also received 18 Nieman Fellowships and 368 White House News Photographers Association awards. The paper is well known for its political reporting and is one of the few remaining American newspapers to operate foreign bureaus. The Post was founded in 1877. In its early years, it went through several owners and struggled both financially and editorially. Financier Eugene Meyer purchased it out of bankruptcy in 1933 and revived its health and reputation, work continued by his successors Katharine and Phil Graham, who bought out several rival publications. The Post's 1971 printing of the Pentagon Papers helped spur opposition to the Vietnam War. Subsequently, in the best-known episode in the newspaper's history, reporters Bob Woodward and Carl Bernstein led the American press's investigation into what became known as the Watergate scandal, which resulted in the 1974 resignation of President Richard Nixon. The advent of the internet expanded the Post's national and international reach. In October 2013, the Graham family sold the newspaper to Nash Holdings, a holding company owned by Jeff Bezos, for $250 million.
Learn more about Washington Post
Industry

Similar Jobs

More Jobs at Washington Post

More Information Technology Jobs

Find similar Senior Data Engineer jobs: