2 Data Engineer / Architect
Client doesn't have much bandwidth for any handholding. They will grant required access and the candidate should work on their own with minimal Apple support. Hence, they need senior level consultant / Architect who can execute the tracks on their own.
Preferred Qualifications:
• Extensive hands-on experience with Spark, Hadoop, Hive, Unix, Teradata, Vertica database
• Must be capable of independent problem-solving and self-direction with an eye towards creating business value for our internal customers
• Experience with distributed infrastructure/application monitoring and observability, including metrics, logs, and traces
• Good interpersonal and communication skills; capable of writing justifications, training and educating users and peer technical staff in complex topics, writing status reports, documenting procedures and interacting positively with other staff and management
• Experience with Python, Spark (PySpark, Scala) programming languages.
• Good understanding of OLAP systems and Data warehousing & Data modeling concepts
• Experience working on Big Data, BI or Analytics related projects
• Advanced knowledge of SQL/Hive
• Advanced Tableau skills
• Experienced with job schedulers developing shell scripts, CRON, Airflow jobs to automate data workflows
• Performance tuning techniques in Spark/Hive/Teradata.
• Advanced knowledge of architecting and scaling complex pipelines
• 8+ years working in data engineering, analysis and infrastructure
• 3+ years functioning in a lead and architect capacity
Location : , CA.
