Bachelor's degree in Computer Science, Informatics, or a related field.
3+ years of experience in a data engineering role.
2+ years of experience with AWS services like EC2, S3, SNS, Lambda, IAM, and Snowflake.
Hands-on experience with ETL tools and techniques is desirable.
Basic proficiency in ANSI SQL, APIs, and Python.
Familiarity with RDBMS platforms like MS SQL Server, MySQL, NoSQL, and Postgres.
Responsibilities
Build and document automated data pipelines focusing on scalability and automation.
Develop applications and APIs for near-real-time data integration using AWS.
Ensure timely delivery of product specifications and technical features in a DevOps environment.
Contribute to the architecture and design patterns for processing high-volume data.
Collaborate to enhance large dataset processing by structuring unstructured data.
Benefits
Day-one onsite collaboration for immediate team integration.
Opportunity to work with cutting-edge AWS technologies.
Full Job Description
Data Engineer MAHIN-JOB-35637
Location -lewisville.( Day 1 onsite)
Salary: $100k & C2C$62/hr
JD : Data Engineer
Responsibilities:
Build and document automated data pipelines from a wide range of data sources with an emphasis on automation and scale: Handled large streaming data set (volume / size) and performed initial Data Pattern identification with AWS-Kinesis.
Develop highly available applications and APIs to support near-real-time integrations using an AWS-based technology stack: Designed and developed REST APIs as prototype to support near-real-time {vehicle / any other domain based} data using SWAGGER and presented the design to the business stakeholders. Converted the prototypes to full scale development using AWS technology stack such as AWS-Event Bridge, AWS-SQS, AWS-SNS & Confluent-KAFKA.
Ensure product and technical features are delivered to spec and on-time in a DevOps fashion: Authored "Software-Design-Specification" based on Product Feature requirement & user stories, implemented within agile-sprint cadence of the program.
Contribute to overall architecture, framework, and design patterns to store and process high data volumes: Collaboratively worked with Architect and contributed on improving the large datasets by decomposing un-structured data into "Structure" , "Semi-Structured" along with design patterns {Circuit Break / MVC, etc} and designed the storage framework with AWS-S3/AWS-Dynamo-DM/AWS-RDS.
Skills:
Bachelors; degree in Computer Science, Informatics, or a related field required
3+ years of experience in a data engineering role
2+ years of experience with AWS and related services (e.g., EC2, S3, SNS, Lambda, IAM, Snowflake)
Hands-on experience with ETL tools and techniques (Desirable)
Basic proficiency with a dialect of ANSI SQL, APIs, and Python
Knowledge of and experience with RDBMS platforms, such as MS SQL Server,
