Senior Data Engineer-Databricks

Versant Holdings 229 West 43rd Street, New York, NEW YORK onsite

full-time

140000 - 160000 USD

Posted on 7 February 2026

Overview

Experienced data engineers with Databricks/Spark expertise are needed to lead lakehouse architecture and production data pipelines for a major media and entertainment company.

Requirements

• SQL proficiency • Python programming • Spark-based data processing • Databricks platform experience • Delta Lake and medallion pipeline patterns • Structured Streaming and Auto Loader • Change Data Capture (CDC) patterns • Unity Catalog and RBAC • Orchestration tools (Airflow, Dagster) • CI/CD, Delta Live Tables, Databricks Workflows • MLflow and feature store familiarity • Monitoring, logging, and alerting • Git and collaborative development workflows • Cloud environments (AWS) and infrastructure fundamentals • Performance tuning and FinOps practices