What you'll do
We are seeking a Senior Software Engineer professional in our Sunnyvale, CA office.
Duties: Create data models using Erwin Data Modeler by working with senior data architects. Build and setup highly scalable data pipelines for continuous data ingestion from various semi-structured sources like databases, SFTP servers, Kafka Clusters, and Elastic Search Index. Perform coding, technical design, data modeling, root cause analysis, investigation, debugging, and testing the ETL for the data mart creation process. Load data into multiple destinations like Teradata, Hive, Thoughtspot, Druid for various use cases. Perform unit and integration testing. Work on Teradata Physical Design and Implementation, Teradata SQL Performance Optimization. Code in Python and Shell scripting using UNIX/LINUX platforms for automation. Create and publish rich and interactive dashboards using latest data visualization technologies. Support business in various ad-hoc requirements on a day to day basis, by performing ad-hoc analysis using complex SQL queries in Teradata and Hive HQL. Use Jira and Confluence for daily effort tracking. Work in Agile environment and follow strict release guidelines.
Minimum education and experience required: Bachelor’s degree or equivalent in Computer Science, Software Engineering, Electronic Engineering or related field and 5 years of experience designing and developing ETL codes; OR Master’s degree or equivalent in Computer Science, Software Engineering, Electronic Engineering or related field and 2 years of experience designing and developing ETL codes.
Skills required: Must have experience with Teradata version 15.x and Tableau versions 9.x and 10.x. Experience with Hadoop, Map Reduce, and Hive. Experience with Oracle 11g. Experience with Apache Kafka. Experience with Python Scripting version 2.7x and Unix Shell Scripting. Experience with UC4 Automation. Experience with GitHub. Experience with PL/SQL. Experience with Confluence version 5.x and Jira version 6.x. Experience with data modeling and ERWIN data modeler r9.64.x. Experience with Box. Experience with Microsoft Office Tools (Excel, Word, and PowerPoint), Keynote, and Pages. Employer will accept any amount of experience with the required skills.