Bachelor's degree in Computer Science, Engineering, Mathematics, Statistics, or related field
2+ years experience in data engineering or related roles
Proficiency in Python, SQL, and data processing frameworks like Spark
Familiarity with AWS services such as Kinesis, Redshift, Glue, Athena, and S3
Ability to collaborate effectively with business users and product owners
Must be legally authorized to work in the U.S. without sponsorship
Responsibilities
Design, build, and operate high-performance, cloud-native infrastructure and services
Establish and maintain scalable containerized and serverless platforms
Develop automation tools and applications using the AWS ecosystem
Design and develop resilient batch and real-time data pipelines
Support and optimize large-scale data pipelines in distributed environments
Evaluate and adopt emerging technologies for improved scalability and resilience
Collaborate with cross-functional teams to translate requirements into solutions
Benefits
Opportunity to work with cutting-edge cloud-native technologies
Engagement in innovative projects that accelerate organizational growth
Collaborative work environment with cross-functional teams
Focus on professional development and staying current with industry advancements
Potential for involvement in machine learning and AI technologies
Full Job Description
Description
Job Overview and Responsibilities
The objective of Data Engineer is to architect, implement and maintain robust data infrastructure that supports the end-to-end pipelines. This includes designing data ingestion processes, optimizing data storage solutions, and ensuring data quality and integrity. By building scalable and efficient systems, the Data Engineer empowers the team to access, preprocess, and analyze data effectively, ultimately facilitating the development and deployment of accurate and impactful data models.
Design, build, and operate high-performance, cloud-native infrastructure and services that accelerate innovation across United
Establish and maintain scalable containerized and serverless platforms, develop automation tools and applications using the AWS ecosystem, and proactively monitor, troubleshoot, and optimize critical data infrastructure
Design and develop resilient batch and real-time data pipelines using Spark, Python, Databricks, and Flink
Apply hands-on engineering expertise to deliver scalable, maintainable, and high-performing data solutions
Support and optimize large-scale data pipelines within distributed, highly available, and horizontally scalable environments
Remain current with advancements in cloud-native engineering and microservices architecture
Evaluate, experiment with, and adopt emerging technologies that improve platform scalability, resilience, developer productivity
Advance intelligent automation through modern AI technologies
Collaborate effectively with cross-functional teams to translate business and technical requirements into practical solutions
Qualifications
What's needed to succeed (Minimum Qualifications):
Bachelor's degree in Computer Science, Engineering, Mathematics, Statistics, or related field
2+ years experience in data engineering or related roles
Proficiency in Python, SQL, data processing frameworks (Spark, pyspark)
Familiar with AWS services such as Kinesis, Redshift, Glue, Athena, S3 etc.
Ability to effectively collaborate with business users and product owners to design optimized data pipelines
Must be legally authorized to work in the United States for any employer without sponsorship
Successful completion of interview required to meet job qualification
Reliable, punctual attendance is an essential function of the position
What will help you propel from the pack (Preferred Qualifications):
Bachelor's degree in a field relevant to Machine Learning
3+ years experience in data engineering or related roles
Advanced knowledge of ML algorithms and techniques
Experience deploying machine learning pipelines into production
Strong understanding of machine learning workflows, along with MLOPs tools and practices for managing ML workflows at scale
About United Air Lines, Inc
United Airlines is a major American airline that operates a large domestic and international route network. The company is headquartered in Chicago, Illinois and is a founding member of the Star Alliance, the world's largest airline alliance. United Airlines operates a fleet of over 800 aircraft and serves more than 350 destinations in over 50 countries.
