Posted By - Owner

Posted On : 28 May 2026 08:48 AM

Detailed Description

Key Responsibilities

-Design, build, and optimize scalable data pipelines using Databricks Unified Analytics Platform.

-Develop and manage ETL/ELT workflows for structured, semi-structured, and streaming data.

-Implement data models, Delta Lake architecture, and data warehouses to support analytics and ML.

-Collaborate with data scientists, analysts, and business teams to deliver insights.

-Ensure data quality, governance, and security compliance across Databricks environments.

-Monitor and improve pipeline performance, cluster utilization, and cost efficiency.

Required Skills 

• Strong proficiency in PySpark, SQL, and Python.

• Hands-on experience with Databricks features (Delta Lake, MLflow, notebooks, jobs).

• Knowledge of cloud platforms (AWS, Azure, GCP) and their integration with Databricks.

• Familiarity with workflow orchestration tools (Airflow, dbt).

• Understanding of data warehousing concepts and BI integration.