Staff Software Engineer Data Engineering Consumer Group in San Diego, CA

Intuit Inc   •  

San Diego, CA 92101

Industry: Enterprise Technology

  •  

8 - 10 years

Posted 55 days ago

Overview

Come join the Consumer Group Data Engineering Team as a Staff Software Engineer. We are leveraging big data technologies to gain new insights into our customer experiences; building data frameworks, ingestion pipelines and tools. Some of the technologies we are leveraging include Hadoop, Vertica, Hive and AWS Big Data Systems.


Responsibilities

  • Designing/developing ETL jobs across multiple big data platforms and tools including S3, EMR, Hive, Vertica
  • 70-85% hands-on development in all phases of the software life cycle.
  • Designing end-to-end data pipeline given business and ops requirements (ingestion, processing and storage).
  • Conduct design and code reviews
  • Defect remediation
  • Estimates and sequence of individual activities as inputs to project plans
  • Analyzes and synthesizes a variety of inputs to create software and services.
  • Identify dependencies as inputs to project plans
  • Collaborates effectively with peer engineers and designs to solve complex problems spanning their respective areas to deliver end-to-end quality in our technology and customer experience.
  • Influences and communicates effectively with non-technical audiences including senior product and business management.
  • Designing/developing ETL jobs across multiple big data platforms and tools including S3, EMR, Hive, Vertica
  • Designing end-to-end data pipeline given business and ops requirements (ingestion, processing and storage).

Qualifications

  • BS or MS in Computer Science or related field.
  • 8+ years of core software development experience with work experience in developing DB schemas, creating ETLs, and familiar with MPP/Hadoop systems.
  • Skilled in developing Software for Java (Spring & Springboot), Scala for spark streaming & spark applications, or other JVM based languages.
  • Working Knowledge of XML, JavaScript, JSON, YML and Linux
  • Advanced experience with scripting language – Python or Shell is a must have
  • Strong knowledge of software development methodologies and practices
  • Experience working in Agile development teams; working knowledge of Agile (Scrum) development methodologies
  • Experience with Amazon web services: EC2, S3, and EMR (Elastic Map Reduce) or equivalent cloud computing approaches
  • Strong expertise in Data Warehousing and analytic architecture
  • Experience working with large data volumes
  • Experience in HTML5, CSS, and other Web technologies a plus.
  • Hands on experience with Hadoop stack of technologies – Hive, Pig, pig-udf
  • Experience creating and consuming SOAP based or JSON/REST web services and communicating with systems.


Valid Through: 2019-11-12