4+ years as a Data Engineer or similar role using Python and SQL in data applications
Experience collaborating on production-level data systems
Proficient in Python and SQL, with solid knowledge of relational databases, especially PostgreSQL
Familiar with Apache Airflow for orchestration
Experience with Business Intelligence tools, such as Tableau
Knowledge of key development principles like cloud infrastructure and automated testing
Effective communication skills for bridging technical and non-technical discussions
Responsibilities
Design and plan new data solutions with team collaboration
Collaborate on software execution and high-quality feature implementation
Drive project execution from specifications to delivery
Share knowledge through code reviews and team training initiatives
Develop expertise in Beam's data environment and reporting ecosystem
Balance tech debt with practical solutions
Foster a team-oriented culture centered around Beam's values
Benefits
Remote-first work environment with optional office space in New York
Stock options available
401k matching program at 50% up to 6% of base salary
Monthly wellness stipend of $100
Annual professional development budget of $750
Full Job Description
About the role
As a Senior Data Engineer on our Engineering team with a focus on data development, you will be working with a team of talented developers responsible for helping create and maintain the data platform, infrastructure, and processes that power the internal and external facing business intelligence that drives Beam's mission. Our data platform processes more than 7TB of data every 90 minutes, delivering complex analytics to our partners and actionable data to our internal stakeholders. You will have the opportunity to work with a wide range of open source data technologies, building new features, supporting existing functionality through bug fixing and enhancements, and will have a significant impact on a core part of our business.
Our Data tech stack
Apache Spark running pyspark
Kubernetes running on EKS; managed using k9s, Helm and eksctl
Apache Airflow as our workflow orchestrator
Testing automation via pytest
uv as our Python package manager
Snowflake as our data warehouse
S3 as our distributed object storage / data lake
What you'll do
Design and plan new platform data solutions through collaboration with our Head of Engineering, our Engineering and product teams, and internal stakeholders using RFC and Tech Spec documents
Collaborate with your peers to execute and implement high-quality software
Collaborate with your peers to assist in planning and execution of new software features, bringing a focus on data platform requirements
Drive the execution of your work from spec document to delivery through our SDLC
Grow your skillset and be a force multiplier by sharing knowledge through code reviews, pair programming, 1-1 conversations, and broader team trainings
Develop subject matter expertise in the Beam data ecosystem and our reporting platform through code development, directly supporting our Client Strategy team, Business Operations, and our partners
Understand and strive to balance tech debt with practicality while designing solutions
Gain knowledge of the nonprofit giving and e-commerce enablement spaces
Foster a team culture around Beam's values of community, inclusivity, care, accountability and support
Strive for continuous improvement through goal setting, feedback, and other growth opportunities
What we're looking for
4+ years as a Data Engineer or Senior Data Engineer utilizing Python and SQL to develop data intensive applications or insights, or 5+ years of experience as a Software Engineer using Python and SQL, working in a primarily Python codebase
Experience working on production-level data systems in a collaborative team environment
Proficient with Python and SQL
Proficient with relational databases, particularly PostgreSQL
Experience with Apache Airflow for task orchestration
Experience using a Business Intelligence tool, like Tableau
Familiar with fundamental development principles and processes such as observability, performance optimization, continuous integration, automated testing, and cloud infrastructure
Familiar with distributed computing architecture, data warehouse and data lake storage patterns
Strong communication skills with the ability to explain and advocate for technical projects to non-technical roles
Nice to haves
Experience in an early startup
Experience with setting up and administrating a Business Intelligence tool, like Tableau
Experience with Apache Spark
Experience with managing a Kubernetes cluster
Bachelor's degree in Computer Science or related technical or analytical field (or equivalent training, fellowship, or work experience)
Up to 10% annual bonus based entirely on individual performance
Stock options
50% match on 401k contributions of up to 6% of base salary
$100 monthly wellness stipend
$750 annual professional development budget
See a full list of perks at https://beamimpact.com/careers
Location - Remote
We are a remote-first company, so our team works from wherever they are. We also have office space in New York, currently in Hearst Tower, where you're free to come work from as well. We have no plans to require in-office work.
