We are looking for Data Engineer who will be responsible for designing, developing, testing, and maintaining software applications and products to meet customer needs. They are involved in the entire software development lifecycle, including designing software architecture, writing code, testing for quality, and deploying software to meet customer requirements. Full-stack software engineering roles, in which employees develop all components of software-including the user interface and server side-also fall within this job function.
Key Responsibilities- Oversee and contribute to the design, development, and implementation of complex, scalable, and resilient data architectures, including data warehouses, data lakes, and streaming platforms.
- Lead the creation, maintenance, and optimization of advanced ETL/ELT processes and data pipelines to ingest, transform, and deliver large volumes of data from diverse sources. Ensure data integrity, quality, and performance across all data flows.
- Assess the requirements of the software application or service and determine the most suitable technology stack, integration method, deployment strategy, and related components.
- Create high-level software architecture designs that outline the overall structure, components, and interfaces of the application.
- Define and implement software test strategies, guidelines, policies, and processes in line with organizational vision, industry regulations, and market best practices.
- Continuously improve performance, optimize applications, and implement new technologies to maximize development efficiency.
- Develop and maintain back-end applications such as APIs and microservices using server-side languages.
Job Requirements
Details:
Required Skills- NoSQL, Kubernetes, Kafka, GCP, Cloud Architecture, Data Architecture, Big Data, Cloud Infrastructure, Apache Spark, BigQuery, Apache Hadoop, Java, Docker, Python, Data Management
Preferred SkillsRequired Experience- 5+ years of progressive experience in data engineering or a related role, with a significant focus on large-scale data systems.
- Expert proficiency in programming languages such as Python or Scala.
- Advanced SQL skills for complex querying, data manipulation, and database design.
- Extensive experience with big data technologies, such as Apache Spark, Hadoop, Kafka, and Flink.
- Proven experience with cloud platforms, including AWS, Azure, or GCP, and their data services, such as: AWS Glue, S3, Redshift, and Athena, Azure Data Factory and Databricks, Google BigQuery and Dataflow
- Strong understanding of data warehousing concepts, data modeling-including dimensional and relational models-and ETL/ELT processes.
- Experience with version control systems such as Git.
Education Required**Listed salary ranges may vary based on experience, qualifications, and local market. Also, some positions may include bonuses or other incentives***Stefanini takes pride in hiring top talent and developing relationships with our future employees. Our talent acquisition teams will never make an offer of employment without having a phone conversation with you. Those face-to-face conversations will involve a description of the job for which you have applied. We will also speak with you about the process, including interviews and job offers.
#LI-PS11
#LI-ONSITE
Pay Range:
$ 61.00 - $ 66.00