Job Description- Develop real time data pipelines and solve big data problems utilizing modern technologies like Spark, Python, Java/Scala, SQL, and AWS cloud environment.
- Write reliable, maintainable, well-documented code that will scale to support millions of respondents.
- Create and maintain optimal data pipeline architecture.
- Execute the full software development life cycle as part of an Agile team.
- Collaborate with Product Managers to refine and modify requirements.
- Follow established design paradigms and design patterns.
- Utilize abilities in unit testing and integration testing.
- Participate in the on-call rotation to monitor shipped features for success and issues.
- Support the business teams and product managers in data extracts and data analysis.
- Demonstrate proficiency in developing software for the user interface, business logic, data modeling and systems, and component integration.
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
- Perform pull requests reviews and CI/CD pipeline integration.
- Develop and manage end-to-end ETL pipelines for both real-time and batch processing, ensuring the secure and efficient migration of large-scale datasets from MSSQL environments to cloud-based data warehouses.
- Engineer robust streaming architecture using SNS, Kinesis Data Streams, and Kinesis Data Analytics to enable real-time insights and schema-validated ingestion, ensuring high-quality data delivery.
- Utilize the following tools and technologies: Github, SQL, REST APIs, and Jira.
- Position allows work from home anywhere in the United States. Headquarters located at 1235 Saint Thomas Street, Suite 201, New Orleans, LA 70130.
Qualifications- The position requires a Master's degree or foreign equivalent degree in Computer Science, Technology Management, or closely related field.
- The qualified candidate must have at least 1 year (12 months) of experience in a software engineer position or closely related occupation.
- The qualified candidate must also have at least 1 year (12 months) of experience with all of the following: (a) performing pull requests reviews and CI/CD pipeline integration; (b) developing and managing pipelines ensuring secure and efficient migration of large-scale datasets; (c) writing and optimizing complex, performance-oriented SQL queries; (d) engineering advanced data features/architectures to ensure high-quality data delivery; and (e) utilizing the following tools and technologies: Github, SQL, REST APIs, and Jira.
- All experience may be gained concurrently.
Additional InformationThe anticipated annualised base pay range for this role is $95,000-$105,893 with the potential for annual on target bonus of up to 10%. In addition, this position is also eligible for the following benefits:
- Medical, Dental, and Vision insurance options to suit you and your family's needs
- 401K with company matching
- PTO, unlimited sick days
- Remote Work
- Paid maternity and paternity leave
