Find similar career opportunities
Data Engineer Category: Software Development/ Engineering
Main location: United States, North Carolina, Cary
Position ID:J1026-1813
Employment Type: Full Time
Position Description: CGI is looking for an experienced and highly motivated Data Engineer to drive the design and development of industry leading, external facing API solutions.
You'll work on large scale digital applications, building intuitive, scalable, and high performing solutions. This is a hands on engineering role for someone who enjoys solving complex problems, working with modern technologies, and delivering high quality software in a collaborative environment
This position is on-site, located in our Cary, NC office.
Your future duties and responsibilities: What You'll Do
. Design, develop, test, deploy, and maintain ETL batch jobs using Spring Batch and Apache Spark/EMR
. Schedule, monitor, and debug ETL Spring Batch and Spark batch jobs
. Build Java clients for consuming REST and SOAP APIs, and Scala Spark batch applications
. Use Apache Spark to process big data and write to NoSQL databases such as Cassandra or Yugabyte
. Build and deploy software solutions on AWS cloud infrastructure
. Provide technical support to squads across the product area building, deploying, and maintaining applications in AWS
. Work across multiple development workstreams while ensuring architecture is scalable, resilient, and extensible
. Ensure technology decisions align with Fidelity's architecture standards and strategies
. Evaluate and recommend technologies/frameworks for flexibility, long term viability, and time to market
. Collaborate with peers through code reviews, pair programming, and daily discussions across multiple squads
Required qualifications to be successful in this role: . Bachelor's degree in Computer Science, Information Systems, or a related field, with a proven track record in data engineering
. 6+ years of software development experience
. 6+ years of experience developing Spark or Spring Batch services for data movement
. Experience scheduling, monitoring, and debugging ETL Spring Batch and Spark batch jobs
. Hands on experience with Java clients consuming REST and SOAP APIs, and Scala Spark batch applications
. Experience developing, testing, deploying, and maintaining ETL batch jobs using Spring Batch and Apache Spark/EMR
. Experience using Apache Spark to process big data and write to NoSQL databases such as Cassandra or Yugabyte
. Proven experience building and deploying software solutions on public cloud providers such as AWS
. Strong understanding of the full software development lifecycle (analysis, design, coding, testing, problem resolution, planning)
. Strong collaboration and communication skills, with the ability to work across multiple squads and adapt to change
. Experience with cloud based data warehousing and data lake solutions such as Snowflake
. Experience with data storage and management for large datasets (e.g., Parquet, HDF5)
Other Information:
CGI is required by law in some jurisdictions to include a reasonable estimate of the compensation range for this role. The determination of this range includes various factors not limited to skill set, level, experience, relevant training, and licensure and certifications. To support the ability to reward for merit-based performance, CGI typically does not hire individuals at or near the top of the range for their role. Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range for this role in the U.S. is $91,800.00 to $160,700.00.
CGI's benefits are offered to eligible professionals on their first day of employment to include:
. Competitive compensation
. Comprehensive insurance options
. Matching contributions through the 401(k) plan and the share purchase plan
. Paid time off for vacation, holidays, and sick time
. Paid parental leave
. Learning opportunities and tuition assistance
. Wellness and well-being programs
Skills: - Cloud Data Platform Design
- Data Engineering
- Data Engineering
- RESTful (Rest-APIs)
- Spark SQL
- Spring Batch
