Amazon Transportation Services (ATS) team is looking for a Data Engineer who is data-driven, uncompromisingly detail oriented, smart, efficient, and driven to help our business succeed. Our team is expected to build and maintain scalable solutions to address increasing operational complexity from the evolution of new processes/challenge such as yard congestion, intermodal, safety risk prediction and etc. We need to continuously innovate on behalf of our customers and develop new platforms and new AI / science-based planning tools to efficiently drive process excellence.
As a Data Engineer, you will be working in one of the world's largest and most complex data warehouse environments. You will design, implement and support scalable data infrastructure solutions to integrate with multi heterogeneous data sources, aggregate and retrieve data in a fast and safe mode, curate data that can be used in reporting, analysis, machine learning models and ad-hoc data requests. You will be exposed to cutting edge AWS data technologies. You should have excellent business and communication skills to be able to work with business owners and Tech leaders to gather infrastructure requirements, design data infrastructure, build up data pipelines and data-sets to meet business needs. You stay abreast of emerging technologies, investigating and implementing where appropriate.
Key job responsibilities
• Synthesize business requirements into data platform architecture for use by business intelligence engineers, data scientists, and product managers.
• Interface with other technology/data engineering teams to extract, transform, and load data from a wide variety of data sources using and AWS data technologies.
• Explore and learn the latest AWS technologies to provide new capabilities and increase efficiencies.
• Maintain and enhance existing data pipelines. Establish new scalable, efficient and automated processes for ingesting data.
• Work closely with BIE leaders, business owners, developers to explore new data sources and deliver solutions for Business Intelligence & Analytics.
• Develop the end-to-end automation of data pipelines, making datasets readily-consumable by visualization tools, machine learning platforms, and daily/weekly/monthly reporting processes.
• Enhance processes to help maintain data integrity, availability, and auditability.
A day in the life
As a Data Engineer, you will develop new data engineering patterns that leverage new cloud architectures, and will extend or migrate existing data pipelines to the architectures as needed. You will be responsible for designing and implementing the complex ETL pipelines in Big data platform and other BI solutions to support the rapidly growing and dynamic business demand for data, and use it to deliver the data as service which will have an immediate influence on day-to-day decision making at Amazon.com
About the team
Amazon Benefits:
Amazon offers a full range of benefits that support you and eligible family members, including domestic partners and their children. Benefits can vary by location, the number of regularly scheduled hours you work, length of employment, and job status such as seasonal or temporary employment. The benefits that generally apply to regular, full-time employees include:
1. Medical, Dental, and Vision Coverage
2. Maternity and Parental Leave Options
3. Paid Time Off (PTO)
4. 401(k) Plan
BASIC QUALIFICATIONS
- 5+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with SQL
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- Experience mentoring team members on best practices
PREFERRED QUALIFICATIONS
- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience operating large data warehouses
