Databricks Data Engineer / Developer (PL 866)

• Location: Remote within Canada
• Client: Consulting Client
• Contract Duration: 6 months contract
• MUST HAVE atleast 3+ years of hands-on Databricks development experience.

Overview

Our consulting client is seeking a Databricks Data Engineer / Developer to support a strategic Enterprise Data Platform (EDP) transformation initiative. The organization is modernizing its enterprise data landscape and building a next-generation data platform leveraging Databricks and modern cloud-based architecture. This role will play a key part in designing, developing, and implementing scalable data solutions that support enterprise reporting, analytics, AI initiatives, and future data-driven capabilities.

The ideal candidate will possess strong data engineering expertise, hands-on Databricks development experience, and a solid understanding of ETL/ELT processes, data integration, and modern data architecture . This individual will work closely with data architects, project managers, analysts, and business stakeholders to deliver high-quality data solutions within a rapidly evolving environment.

Key Responsibilities

• Design, develop, and maintain data pipelines within the Enterprise Data Platform (EDP) .
• Build and optimize ETL/ELT processes to support data ingestion, transformation, and integration requirements.
• Make use of an Agentic approach to development and ensure that output matches development standards.
• Develop scalable and reusable data solutions using Databricks and cloud-based data technologies .
• Support migration and modernization activities from HANA environments to a modern data platform .
• Collaborate with Data Architects to implement scalable data models and platform solutions.
• Develop data transformation logic and workflows to support business and analytics requirements.
• Ensure data quality, integrity, consistency, and performance across platform solutions.
• Troubleshoot and resolve data-related issues, bottlenecks, and performance concerns.
• Participate in code reviews, testing, deployment, and release activities.
• Work closely with business and analytics teams to understand data requirements and deliver fit-for-purpose solutions.
• Contribute to platform best practices, documentation, and continuous improvement initiatives.

Requirements

MUST HAVE atleast 3+ years of hands-on Databricks development experience.

Required Qualifications

• 3+ years of hands-on Databricks development experience .
• 4+ years of overall Data Engineering, ETL, or Data Integration experience.
• Strong experience building ETL/ELT data pipelines and transformation processes.
• Proven experience working with large and complex datasets.
• Experience with Agentic frameworks and AI-assisted coding is a value add.
• Experience developing data solutions within cloud-based platforms.
• Solid understanding of data warehousing, data lake, and lakehouse concepts.
• Experience working in Agile delivery environments.
• Strong problem-solving and analytical skills.
• Excellent communication and collaboration abilities.

Preferred Qualifications

• Experience supporting large data platform initiatives.
• Experience in significant data migration efforts.
• Experience with Azure Data Services and Databricks Lakehouse architecture.
• Experience with modern data engineering frameworks and best practices.
• Exposure to AI, GenAI, Machine Learning, or advanced analytics initiatives.
• Experience working in large enterprise or consulting environments.
• Knowledge of data governance, metadata management, and data quality frameworks.
• Technical Knowledge
• Required
• Databricks
• ETL / ELT Development
• Data Engineering
• Data Integration
• SQL
• Python
• Data Pipeline Development

Data Transformation

• Data Warehousing Concepts
• Agile Delivery
• Preferred
• Azure Data Factory

Delta Lake

Spark / PySpark

Azure Synapse

Data Lake Architecture

Cloud Data Platforms

• Data Governance & Data Quality
• CI/CD for Data Solutions
• Key Skills & Experience
• Databricks Development

Data Engineering

• ETL/ELT Design & Development
• Enterprise Data Platforms
• Data Modernization

Data Migration

Data Warehousing

Cloud Data Platforms

• SQL & Python Development
• Data Quality & Validation

Agile Delivery

Stakeholder Collaboration

Ideal Candidate Profile

We are seeking a developer who:

• ✅ Has hands-on Databricks experience and can contribute immediately
• ✅ Understands enterprise data concepts and platform modernization initiatives
• ✅ Has strong ETL/ELT and data engineering experience
• ✅ Can partner effectively with architects, project managers, and business teams
• ✅ Is comfortable working in a fast-paced, highly visible enterprise transformation program
• ✅ Can help build a scalable lakehouse architecture supporting reporting, analytics, and future AI capabilities
• Originally posted on Himalayas