Wpromote

Senior Software Engineer II (Data Pipelines)

Wpromote$155K — $180K *
US-AnywhereRemote in United States
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Minimum 7+ years of experience in software development, specializing in Python, SQL, and data pipelines.
  • Expertise in ETL/ELT automation using Airflow; familiarity with Airbyte preferred.
  • Proficiency in managing dbt models, including macros and tests.
  • In-depth knowledge of databases like PostgreSQL and BigQuery, with query optimization skills.
  • Experience with business intelligence tools, preferably Looker or similar.
  • Familiarity with Google Cloud Platform, Kubernetes, and infrastructure as code tools like Terraform.
  • Strong problem-solving abilities and technical leadership experience.

Responsibilities

  • Lead the automation and orchestration of data pipelines as a technical expert.
  • Design and maintain scalable, reliable data solutions emphasizing automation.
  • Manage and optimize a large portfolio of dbt models with advanced techniques.
  • Promote test-driven development and assist in continuous integration processes.
  • Monitor, troubleshoot, and enhance data pipeline performance.
  • Architect reusable and scalable data solutions aligned with business demands.
  • Document implementation plans, configurations, and deployments.

Benefits

  • Unlimited PTO for work-life balance.
  • Extended holiday breaks, especially in winter.
  • 100% paid parental leave to support family needs.
  • 401(k) matching to aid in retirement planning.
  • Comprehensive medical, dental, vision, and other insurance options.
  • Annual Class Pass credits for professional development.
  • Flexible remote work options with hub access for collaboration.
Full Job Description
The Role

As a Senior Engineer, you will play a crucial role in the development, optimization, and automation of our data pipelines. You will lead complex data projects, architect technical initiatives, and ensure the scalability and performance of our data solutions. Your role will involve strategic planning, collaboration with senior management, and mentoring other engineers. You will be responsible for pushing the delivery speed and quality of our data ELT, leading the implementation of innovative tooling and architecture patterns, and fostering a culture of data engineering excellence.

At Wpromote, we're developing something special called Polaris, a modern data and marketing intelligence platform that gives our clients a serious edge over their competition. Polaris enables and empowers our marketing teams to work together seamlessly, using a comprehensive marketing data foundation with apps that deliver new insights and performance gains for our clients. Polaris also gives Wpromote an operational edge, doubling as our company CRM and integrated source of truth for operations data, making our lives easier and our decisions smarter.

We offer:

-Unlimited PTO

-Extended Holiday break (Winter)

-100% paid parental leave

-401(k) matching

-Medical, Dental, Vision, Life, Pet Insurance

-Sponsored life insurance

-Short Term Disability insurance and additional voluntary insurance

-Annual Class Pass credits and more!

The anticipated annual salary for this role will range from $155,000 - $180,000, based on a variety of factors unique to each candidate, including skill set, years and depth of experience, education and certifications, competitive benchmarks, scope of responsibility, market dynamics, geographic location, and the respective state's salary threshold for exempt employees. At Wpromote, pay ranges are subject to change and are based on specific market medians for similar jobs according to third-party salary benchmark surveys. Individual pay within that range can vary due to skills, experience, and available budget. The total compensation package for this role will include benefits (listed above).

This position may be performed remotely in most states within the US, with some exclusions

**While this role offers the flexibility to work remotely, we have office hubs in Los Angeles, Chicago, and New York, where you can join in on learning and development opportunities, fun events, take advantage of a space to work, and collaborate in person!

***This position is not eligible for immigration sponsorship

You Will Be

  • Acting as a technical leader and Subject Matter Expert (SME) in data pipeline automation and workflow orchestration.
  • Designing, implementing, and maintaining complex, reliable, data solutions with a focus on automation using Airflow, dbt, and Google Cloud data products.
  • Managing a large portfolio of dbt models, leveraging macros and DRY patterns.
  • Advocating for test-driven development and assisting QA in developing a robust and reliable process for continuous integration and delivery.
  • Monitoring, troubleshooting, and optimizing the performance of data pipelines and workflows.
  • Architecting solutions and reusable patterns that scale with business needs.
  • Providing implementation, configuration, and deployment documentation.
  • Proactively addressing issues and problems, generating and implementing innovative solutions.
  • Participating in all agile ceremonies, including daily standups and regular sprint planning.
  • Mentoring other engineers and fostering a culture of technical excellence.
  • Staying up-to-date with the latest industry trends and technologies to drive continuous improvement and innovation in data engineering practices.
  • Ensuring data security, governance, and compliance with relevant standards and privacy restrictions.


You Must Have

  • Minimum 7+ years of experience in software development, with extensive experience in Python, SQL, and data pipelines.
  • Expertise in building and automating ETL/ELT pipelines using Airflow and DAG-based workflow management software. Airbyte for data ingestion is a plus, but not required.
  • Deep experience managing dbt models using macros and dbt tests.
    Mastery of Python or comparable scripting language, API integrations, and software architecture.
  • Deep experience with databases like PostgreSQL and BigQuery, including query optimization for performance and cost.
  • Good understanding of business intelligence tools like Looker or comparable alternatives.
    Experience with Google Cloud Platform, Kubernetes, and managing infrastructure as code using Terraform.
  • Proficiency with advanced data formats (Parquet, Avro, Hive, JSONL) and data integration techniques.
  • Experience with monitoring and logging tools (e.g., Prometheus, Grafana) is a plus.
  • Familiarity with version control systems and CI/CD tools like GitHub Actions.
  • Strong command of agile methodologies, continuous integration, and test-driven development.
  • Exceptional problem-solving skills and technical leadership.
  • Ability to influence and guide cross-functional teams and projects.

About Wpromote

Wpromote is a digital marketing agency that was founded in 2001 by Michael Mothner. The company is headquartered in Los Angeles, California and has additional offices in New York, Chicago, and Dallas. Wpromote offers a range of digital marketing services, including search engine optimization, paid search advertising, social media marketing, and email marketing. The company has worked with a number of well-known brands, including Marriott, Verizon, and Toyota. Wpromote has received several awards for its work, including being named the #1 Best Place to Work in Advertising & Marketing by Fortune Magazine in 2019.
Learn more about Wpromote
Size
500 employees
Industry

Similar Jobs

More Jobs at Wpromote

More Information Technology Jobs

Find similar Senior Software Engineer II (Data Pipelines) jobs: