Lead Data Engineer

• Proficient in Python, SQL, PySpark and shell scripting (bash). • Experience with cloud data warehousing platforms (Redshift, Snowflake, Databricks SQL or equivalent). • Hands-on experience with Spark and distributed data processing frameworks. • Experience building pipelines for structured and unstructured data. • Familiarity with REST APIs and various data extraction/integration patterns. • Experience with CI/CD (eg. Jenkins), version control (GitHub/Bitbucket), and orchestration (Airflow, Prefect). • Knowledge of data modeling and warehousing techniques. • Experience designing streaming or real-time data solutions. • Strong debugging, monitoring, and performance optimization skills. • Excellent communication and cross-functional collaboration skills.