JOB DESCRIPTION
Job Title: Data EngineerExperience: 3+ Years Location: Pittsburgh Job Summary
We are looking for a highly skilled Data Engineer with strong expertise in Python and SQL, along with hands-on experience in DevOps and CI/CD practices. The role involves building scalable data pipelines, optimizing data systems, and enabling efficient data-driven solutions.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using Python and SQL.
- Build and optimize data ingestion and transformation frameworks for large datasets
- Develop robust solutions for data processing, validation, and quality assurance
- Implement CI/CD pipelines and DevOps practices for data engineering workflows
- Automate data pipelines, deployment, and monitoring processes
- Work with cross-functional teams to understand business requirements and deliver data solutions
- Troubleshoot and optimize performance of data pipelines and systems
Must-Have Skills
- Hands-on experience in Python and SQL
- Experience in data engineering concepts: ETL/ELT, data modeling, data warehousing
- Solid exposure to DevOps tools & practices (CI/CD, Git, Jenkins, Docker, etc.)
- Experience in building production-grade data pipelines
- Strong debugging, problem-solving, and optimization skills
Good to Have
- Experience with PySpark / Big Data technologies
- Exposure to cloud platforms.
- Knowledge of workflow orchestration tools (Airflow, etc.)
- Understanding of data governance and quality frameworks
Qualification:
- Bachelor's degree in related field
JOB RESPONSIBILITIES
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using Python and SQL.
- Build and optimize data ingestion and transformation frameworks for large datasets
- Develop robust solutions for data processing, validation, and quality assurance
- Implement CI/CD pipelines and DevOps practices for data engineering workflows
- Automate data pipelines, deployment, and monitoring processes
- Work with cross-functional teams to understand business requirements and deliver data solutions
- Troubleshoot and optimize performance of data pipelines and systems
JOB QUALIFICATIONS
Graduate in Computer Science, Data Science, or related field. 3-6 years of experience in data engineering or related field.
Base Compensation Range: $100-125k
The posted range is the hiring range for this role 1 a subset of the broader range available to employees over time 1 and reflects base salary across our national hiring scale. Final offers are based on several factors, including the candidate's skills and experience, internal pay equity, work location, market conditions for the role, and the specific scope and responsibilities of the position. The top of the range is reserved for candidates who notably exceed the requirements; the lower end applies to those with less experience or fewer preferred qualifications. For positions based in higher-cost zones (e.g., California, New York, New Jersey), actual compensation may exceed the posted range; your recruiter will share specifics during the process.
