Tech Specialist TECHM-JOB-25850
Location: Atlanta GA
Skill: Enterprise Architecture Foundation
Full Time
Role: Big-Data Architect
Responsibilities
Minimum of 18+ Years of experience in IT and 4-5yrs experience in Big Data development and a hand-ons experience on performance tuning E2E data pipeline.
Demonstrate issues faced in implementation and performance tuning experience in previous project and best practices following in performance implementations
Create Scala/Spark jobs for data transformation and aggregation with a focus on the functional programming paradigm.
Help in designing, building, and enhancing platform and ensure that developed components are testable, repeatable, highly performant, scalable, and automated.
Write Scala doc-style documentation with all code & design data processing pipelines
Batch interfaces and Real-time interfaces like Kafka messaging
Good presentation and communication skills to express what is being worked on day-2-day activities
Proficient in Java and Scala and C++, fixing/redesigning native libraries, knowledge of Python is a plus
Prior experience or understanding on in-memory data storage and No-SQL DB like Redis, MongoDB & Cassandra
Familiarity with Unix scripting & Automation
Past experience in BigData development is preferable (Streaming on Apache Flink or Apache Spark) or else should be able to demonstrate conceptual differences between batch and streaming data processing
Past experience in DataWarehouse/ETL/SQL development is preferable who can understand the E2E data flow or the application architecture
Azure Integration and deployment experience would be a plus
Quick learner who can come out with alternate options to solve an application problem
Expected Qualifications
BS or MS degree in Computer Science, Software Engineering, or related field
Good written and verbal communication skills
Orientation in modern standards and technical trends
Orientation in surrounding frameworks and libraries, particularly Play
Experience with microservices architectures, scalability, reliability, and fault tolerance
Experience with continuous and iterative development
Atlassian tools
Experienced working in an Agile development environment, Continuous Integration and Delivery practices
Cassandra / other No SQL databases experience & Reactive Systems
Strong analytical and problem solving skills and data-driven thinking