CIBC

Lead Data Engineer (Python, Databricks, SQL)

CIBC$150K — $165K *
Finance & Insurance
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 8-12 years of related experience, preferably in financial services or tech.
  • Expertise in Azure and Databricks data engineering including PySpark/Scala and ETL processes.
  • Strong SQL Server development skills; SSIS experience is desired.
  • Proficient in DevOps practices with a focus on CI/CD, and security compliance.
  • Agile delivery expertise using Jira/Azure DevOps; adept at managing priorities and velocity.
  • Excellent executive-level communication skills for governance forums.
  • Degree in Computer Science, Engineering, MIS, or equivalent experience.

Responsibilities

  • Own end-to-end delivery of U.S. Data Strategy capabilities including ETL and analytics.
  • Translate business objectives into secure, scalable cloud data solutions.
  • Improve SDLC throughput and drive innovations through proofs of concept.
  • Define technical architectures that reduce technical debt and enhance security.
  • Lead technical practices in developing solutions using Databricks and SQL.
  • Embed risk management and compliance in all aspects of the work.
  • Set and manage strategic goals aligned to the product roadmap.

Benefits

  • Comprehensive benefits package including Medical, Dental, and Vision.
  • Paid Time Off, including Sick Leave and Parental Leave.
  • 401(k) retirement plan and other financial wellness benefits.
  • Personalized recognition programs for achievements and milestones.
  • Paid day off for professional development through Purpose Day.
Full Job Description
What You'll Be Doing

The Lead Data Engineer will own end-to-end delivery of U.S. Data Strategy capabilities, including ETL, analytics, and data consumption, aligned to a multi-year product roadmap. They will translate business and product objectives into secure, scalable cloud data solutions in partnership with Product, Architecture, Data, and key stakeholders. Continuously improve SDLC throughput via intake/estimation and KPI management, and drive innovation through proofs of concept and continuous modernization. This is a hands-on position.

CIBC we enable the work environment most optimal for you to thrive in your role. You'll have the flexibility to manage your work activities within a hybrid work arrangement where you'll spend 2 days per week on-site, while other days may be remote.

How You'll Succeed
  • Strategic Delivery: Set goals aligned to strategy; translate priorities into roadmaps, metrics, dependencies, and release plans; manage capacity and resourcing. Leverage GitHub Copilot in development best practices.
  • Technical Strategy and Architecture: Define secure, scalable architecture; modernize and reduce technical debt. Drive best practice engineering through automation, testing, CI/CD, observability, and continuous improvement.
  • Industry and Domain Leadership: Apply banking/domain expertise to guide platform direction and improve client and operational outcomes.
  • Risk and Compliance Oversight: Embed risk management and security/privacy by design; ensure regulatory compliance and partner with Compliance/Audit. You oversee risk management activities within their area, influence risk culture, and align risk management with departmental goals. You also Oversee compliance adherence within their area of responsibility; ensure alignment with regulatory requirements; engage with Compliance and Audit teams as needed.
  • Lead by Example: Provide Technical Leadership, be able to develop solutions based on Databricks/Python/PySpark as well as strong SQL Server experience.


Who You Are
  • You possess 8-12 years of related experience OR Combination of education and experience, ideally within financial services or tech.
  • You possess Azure/Databricks data engineering expertise (PySpark/Scala, ETL, Azure SQL, REST APIs). Expertise in data ingestions, data pipeline development, and optimization, reporting, and advanced analytics using Azure and Databricks (Pyspark/Scala) services and/or SQL Server/SSIS is a must.
  • Strong SQL Server development experience (required) and SSIS (desired) along with strong pipeline delivery skills (ingestion, transformation, optimization, reporting/analytics).
  • You bring DevOps/SDLC excellence (CI/CD, environment integrity, security, compliance, release management) along with an exposure to Integration and BI Tools such as Tableau, Cognos or Power BI. Automation mindset to reduce manual processes and improve operational efficiency is desired.
  • Agile delivery mastery (Jira/Azure DevOps, story writing/pointing, velocity management).
  • Executive-level communication for technical recommendations and governance forums.
  • Degree/diploma in Computer Science, Engineering, MIS, or related field or relevant certifications and/or completion of a relevant bootcamp
  • Extensive knowledge of banking products (desired), services, and industry regulations; expert understanding of current industry trends and developments; ability to influence strategic decisions using industry knowledge


California residents - your privacy rights regarding your actual or prospective employment

At CIBC, we offer a competitive total rewards package. This role has an expected salary range of $150,000.00 - $165,000.00 for the Chicago market based on experience, qualifications, and location of the position. The successful candidate may be eligible to participate in the relevant business unit's incentive compensation plan, which may also include a discretionary bonus component. CIBC offers a full range of benefits and programs to meet our employee's needs; including Medical, Dental, Vision, Health Savings Account, Life Insurance, Disability, and Other Insurance Plans, Paid Time Off (including Sick Leave, Parental Leave and Vacation), Holidays and 401(k), in addition to other special perks reserved for our team members."

This position does not offer visa sponsorship.

#LI-TA

Job Location
IL-Chicago, 70 W Madison St Fl 8

Employment Type
Regular

Weekly Hours
40

Skills
Analytical Thinking, Application Development, Applications Programming, Azure API Management, Azure App Service, Azure Blob Storage, Azure Repos, Azure Storage, Databricks Platform, Databricks SQL, Databricks Unity Catalog, Emerging Technologies, Mentoring Staff, Microsoft Azure, Microsoft Azure Databricks, Microsoft Azure Functions, PySpark, Python Software Development, SQL Server Integration Services (SSIS), SSIS Packages, Work Collaboratively

About CIBC

The Canadian Imperial Bank of Commerce is a Canadian multinational banking and financial services corporation headquartered in Toronto, Ontario. The bank is headquartered at Commerce Court in the city's Financial District. CIBC's Institution Number is 010, and its SWIFT code is CIBCCATT. It is one of two Big Five banks founded in Toronto, the other being the Toronto-Dominion Bank. The Canadian Imperial Bank of Commerce was formed through the June 1, 1961, merger of the Canadian Bank of Commerce and the Imperial Bank of Canada, the largest merger between chartered banks in Canadian history. The bank has four strategic business units: Canadian Personal and Business Banking, Canadian Commercial Banking and Wealth Management, U.S. Commercial Banking and Wealth Management, and Capital Markets. It has international operations in the United States, the Caribbean, Asia, and United Kingdom; Globally. CIBC serves more than eleven million clients, and has over 40,000 employees. The company ranks at number 172 on the Forbes Global 2000 listing.
Learn more about CIBC
Market Cap
$43.5 billion
Industry
Founded
1867
5 Year Trend
+8.8%

Similar Jobs

More Jobs at CIBC

More Finance & Insurance Jobs

Find similar Lead Data Engineer (Python, Databricks, SQL) jobs: