Must Have Technical/Functional Skills
• Design and develop scalable data pipelines and ETL workflows using Databricks (Spark, PySpark)
• Build and optimize Delta Lake architectures for high-performance data processing
• Develop and deploy AI/ML models and advanced analytics solutions
• Implement Agentic AI / GenAI solutions using Databricks (e.g., Agent Bricks, LLM-based workflows)
• Develop BI and analytics datasets for downstream reporting and visualization
• Collaborate with business and data science teams to translate requirements into solutions
• Optimize performance, cost, and scalability of data pipelines on cloud platforms
• Ensure data quality, governance, and compliance standards are met
• Excellent problem-solving and communication skills.
Roles & Responsibilities
We are seeking an experienced Databricks Developer to design, develop, and optimize scalable data and AI-driven solutions on cloud platforms. The role requires strong expertise in data engineering, machine learning, and modern analytics leveraging Databricks and AI frameworks.
Key Responsibilities
• Design and develop scalable data pipelines and ETL workflows using Databricks (Spark, PySpark)
• Build and optimize Delta Lake architectures for high-performance data processing
• Develop and deploy AI/ML models and advanced analytics solutions
• Implement Agentic AI / GenAI solutions using Databricks (e.g., Agent Bricks, LLM-based workflows)
• Develop BI and analytics datasets for downstream reporting and visualization
• Collaborate with business and data science teams to translate requirements into solutions
• Optimize performance, cost, and scalability of data pipelines on cloud platforms
• Ensure data quality, governance, and compliance standards are met
Required Skills & Experience
• Strong hands-on experience with Databricks (Workflows, Delta Lake, Unity Catalog)
• Expertise in ETL/Data Engineering using Spark/PySpark
• Experience with AI/ML model development and deployment
• Knowledge of Agentic AI / GenAI frameworks and LLM integration
• Strong understanding of cloud platforms (AWS / Azure / GCP)
• Experience with BI tools (Power BI, Tableau, etc.)
• Proficiency in SQL, Python
Salary Range: $100,000 to $140,000 per year
