Tata Consultancy Services

Databricks Data Engineer with a Solution Architect

Tata Consultancy Services$140K — $150K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience in Data Engineering and Solution Architecture
  • Strong expertise in Databricks, Spark, and Delta Lake
  • Proven skills in cloud architecture (Azure, AWS, GCP)
  • Solid understanding of Infrastructure as Code (IaC)
  • Experience with AI/ML enablement and data governance strategies

Responsibilities

  • Designs and governs enterprise-scale data platforms using Databricks and Spark
  • Leads architecture decisions ensuring scalability and security for cloud-based solutions
  • Establishes best practices and governance frameworks for data engineering and analytics
  • Recommends innovative technologies to enhance platform performance and cost efficiency
  • Leads complex initiatives involving cloud modernization and data platform transformation
  • Designs and optimizes real-time and batch data pipelines utilizing Spark and distributed computing
  • Provides technical leadership and mentorship, promoting best practices across the organization

Benefits

  • Discretionary Annual Incentive
  • Comprehensive Medical Coverage including Dental & Vision
  • Maternal & Parental Leave support
  • Insurance options including Identity Theft Protection
  • Training reimbursement and commuter benefits
  • Vacation, Sick Leave, and Holidays
  • Legal Assistance and 401K Plan options
Full Job Description
Must Have Technical/Functional Skills

As a Databricks Data Engineer with a Solution Architect background, you will lead the design of enterprise-scale data solutions, establish engineering standards and best practices, optimize platform performance and cost, and provide technical leadership for cloud modernization, real-time analytics, AI/ML enablement, and data governance initiatives. This role requires strong expertise in Spark, Delta Lake, Unity Catalog, cloud architecture, Infrastructure as Code (IaC), and modern data platform engineering principles to deliver secure, resilient, and highly scalable solutions.

We are seeking a highly skilled and experienced Senior Solution Architect to lead the implementation and adoption of the Databricks Lakehouse Platform as part of our enterprise data strategy. This role will serve as the technical leader and subject matter expert for Databricks, supporting multiple business segments and strategic initiatives across the organization

Roles & Responsibilities

Responsibilities
• Applies advanced expertise in Databricks, Spark, Delta Lake, and cloud-native architectures to design and govern large-scale enterprise data platforms.
• Leads architecture decisions for cloud-based data and analytics solutions, ensuring scalability, security, resiliency, and operational excellence across Azure, AWS, or GCP environments.
• Establishes and evolves platform standards, best practices, and governance frameworks for data engineering, streaming, AI/ML, and analytics workloads.
• Recommends innovative technologies, architectural patterns, and optimization strategies to improve platform performance, reliability, and cost efficiency.
• Works on and may lead highly complex, cross-functional initiatives involving cloud modernization, data platform transformation, and enterprise architecture adoption.
• Designs and optimizes high-volume batch and real-time data pipelines, leveraging deep knowledge of Spark internals, Structured Streaming, and distributed computing principles.
• Provides architectural leadership for Delta Lake, Unity Catalog, security, data governance, and data-sharing capabilities across multiple business domains.
• Drives Infrastructure as Code (IaC), DevOps, and CI/CD adoption using Terraform, Databricks Asset Bundles (DABs), and modern software engineering practices.
• Independently determines architectural approaches, technology choices, and implementation strategies for new and evolving platform capabilities.
• Receives guidance on strategic business objectives while exercising significant discretion in technical and architectural decision-making.
• Provides expert consultation to leadership, engineering teams, and business stakeholders, delivering solutions that may establish enterprise-wide standards and precedents.
• Acts as a technical mentor and thought leader, elevating engineering capabilities and promoting architecture best practices across the organization.
• Influences long-term cloud, data, and AI platform strategy, ensuring solutions align with b usiness goals, regulatory requirements, and future growth needs
•Salary Range: $140,000- $150,000 a year

TCS Employee Benefits Summary:

Discretionary Annual Incentive.

Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.

Family Support: Maternal & Parental Leaves.

Insurance Options: Auto & Home Insurance, Identity Theft Protection.

Convenience & Professional Growth: Commuter Benefits & Certification & amp; Training Reimbursement.

Time Off: Vacation, Time Off, Sick Leave & Holidays.

Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

#LI-SP1

About Tata Consultancy Services

Tata Consultancy Services (TCS) is an Indian multinational information technology (IT) services and consulting company, headquartered in Mumbai, Maharashtra, India. It is a subsidiary of Tata Group and operates in 149 locations across 46 countries. TCS is the largest Indian company by market capitalization and is ranked 11th on the Forbes Global 2000 list of the world's biggest public companies. TCS is also the second-largest IT services company in the world by revenue and the largest employer of women in India. The company provides services in areas including IT, consulting, and business solutions.
Learn more about Tata Consultancy Services
Size
469,261 employees
Industry

Similar Jobs

More Jobs at Tata Consultancy Services

More Information Technology Jobs

Find similar Databricks Data Engineer with a Solution Architect jobs: