Senior Data Engineer – Databricks

About the role

Intetics is looking for a Senior Data Engineer to own and operate Databricks pipelines that power a predictive data platform for mid‑market enterprises. You will ensure data reliability, cost efficiency, and scalability while supporting customer onboarding and legacy migration.

Key responsibilities

• Provide production support for Databricks pipelines, including monitoring, alerting, and incident response.
• Maintain SLA metrics, optimize compute costs, and improve pipeline throughput.
• Migrate legacy ETL/ELT pipelines to Databricks and automate the transition.
• Provision, validate, and harden tenant data pipelines for new customers.
• Design high‑performance pipelines that ingest ERP and CRM data across Azure and AWS.
• Own Delta Lake architecture, schema design, partitioning, and incremental processing.
• Enforce data security, role‑based access, and multi‑tenant isolation.
• Collaborate with ML engineers, product, and enterprise architecture teams.
• Participate in on‑call rotation and maintain technical documentation.

Required profile

• 4+ years of data engineering experience.
• At least 2 years working with Databricks or Apache Spark on Azure and/or AWS.
• Strong proficiency in PySpark, SQL, and Python.
• Hands‑on experience with Delta Lake, PostgreSQL, and legacy ETL tools (e.g., SSIS, Informatica).
• Experience with multi‑tenant architectures and data governance.

Required skills

• Databricks, Apache Spark
• PySpark, Python, SQL
• Delta Lake
• PostgreSQL
• Azure, AWS
• SSIS or Informatica
• CI/CD for data pipelines
• Data security and compliance