Job DescriptionU.S. Bank is seeking the position of Lead Software Engineer in Irving, TX.
Essential Responsibilities: The Lead Software Engineer will be responsible for architecting and designing data products for Customer 360 users; partnering with the Product team to understand new analytics needs and design, build data pipelines; coaching team in building data pipelines in Scala Spark as per engineering standards; identifying data classification of a given project and work with BISO in define security strategy of the application and data; building CICD pipelines for Customer 360 Projects using GitLab CI and Jenkins; building Build Data pipeline in On-prem Hadoop platform using spark (scala , python & SQL) based pipelines with Dataframe APIs and spark-SQL; and developing Azure Cloud based data pipelines using Spark on Kubernetes, storing the data in delta tables, and orchestrating them using Airflow or Azure Synapse as a Semantic layer. Migrate mainframe application to Azure platforms by leveraging technologies (e.g., COBOL, JCL, VSAM, DB2). Implement data quality checks, monitoring, and alerting mechanisms using Datadog, Splunk, Grafana, InfluxDB, and ServiceNow. Build test suites and make sure coverage is minimum 90% and keep code smells under 5 thru sonarQube. Perform POCs on Gen-AI implementation such as gitlab co-pilot, RAG and Agentic AI. Position may allow working from home within commuting distance of worksite location. Multiple positions.
Basic Qualifications:
Requires a Bachelor’s degree (or foreign equivalent) in Computer Science, Computer Information Systems, or Electrical and Electronic Engineering, plus 5 years of progressive, post-baccalaureate experience as a Data Engineer, Software Engineer, or related
Required Skills/Experience:
Must possess 5 years of experience with: architecting and designing data pipelines and application and build integration between mainframe and spark/Hadoop echo system; creating reusable components to be used in multiple pipelines; developing application health check dashboard and monitors using Datadog, Splunk & Grafana; defining Metadata of a given dataset; building CICD pipelines for TLRC projects using Jenkins/Drone; data quality checks and processes created for every pipeline; performing Code reviews on pull requests; implementing data quality monitors and creating automated alert on Service-now; Performance tuning on spark data pipelines; and utilizing the following tools and technologies: Spark; Scala; Python; ADLS Gen2; ADF; Delta-tables; Databricks; Synapse (Dedicated/ Serverless); HiveQL; SparkSQL; HadoopMapReduce; HDFS; GIT; Airflow; Jira; Sqoop; Postgres; Shell Script; Influx DB; DataDog; Splunk sonarQube; Grafana;Gen-AI; Agentic AI; RAG; COBOL; JCL; DB2; and VSAM. Experience may be gained concurrently. Position may allow working from home within commuting distance of worksite location.
Base pay range may vary if an offer is made for work in a different location. Pay Range: $170,144 - $196,000. (#LI-NDI #LI-DNI #LI-DNP #DE-DNP #IND-DNP)
- The examination for this position may include a supplemental questionnaire. Improper or missing responses could affect your application.
- This position is not eligible for visa sponsorship.
Benefits:
Our approach to benefits and total rewards considers our team members’ whole selves and what may be needed to thrive in and outside work. That's why our benefits are designed to help you and your family boost your health, protect your financial security and give you peace of mind. Our benefits include the following:
Healthcare (medical, dental, vision)
Basic term and optional term life insurance
Short-term and long-term disability
Pregnancy disability and parental leave
401(k) and employer-funded retirement plan
Paid vacation (from two to five weeks depending on salary grade and tenure)
Up to 11 paid holiday opportunities
Adoption assistance
Sick and Safe Leave accruals of one hour for every 30 worked, up to 80 hours per calendar year unless otherwise provided by law
Review our full benefits available by employment status here.
