Staff Engineer, Analytics Engineering

Do you have a passion for building innovative data pipelines and transforming raw data into actionable insights? Are you an expert in programming languages like Spark, SQL, and Python, and thrive in a collaborative environment? If so, we want to hear from you! About the role: We are seeking a talented and experienced Analytics/Data Engineer to join our growing team. In this role, you will play a key part in designing, developing, and maintaining the data pipelines that power our organization's data-driven decision making. You will work closely with data scientists, analysts, and other engineers to ensure that our data infrastructure is reliable, scalable, and secure. Responsibilities: • Design, develop, and maintain scalable and efficient data pipelines using Spark, SQL, and Python • Utilize Databricks platform to build and manage data processing workflows • Clean, transform, and integrate data from various sources into a unified and consistent format • Implement data quality checks and monitoring processes to ensure data accuracy and completeness • Collaborate with data scientists and analysts to understand their data needs and develop solutions • Document data pipelines and processes using clear and concise language • Utilize Git for version control and maintain a clean and collaborative development environment • Follow software development best practices, including unit testing, code reviews, and continuous • integration/continuous delivery (CI/CD) • Stay up to date with the latest advancements in data engineering technologies and best practices. Basic Qualifications: • Bachelor's degree in Computer Science, Information Technology, or a related field • Minimum 5 years of experience as a Data Engineer or similar role • Strong proficiency in SQL, Python, and Spark • Familiarity with Databricks platform • Experience with data warehousing and data lakes (e.g., AWS Redshift, Snowflake) is a plus • Experience with Git and software development best practices (unit testing, code reviews, CI/CD) • Experience leveraging Gen AI tooling. • Excellent communication and collaboration skills • Ability to work independently and as part of a team