Back to jobsJob overview

About the role

Tech Lead Databricks Data Engineer at Mitre Media

Required Skills

pythondatabrickssparksqlawsgcpetldata modelingfintech

About the Role

Tech Lead Data Engineer role at Mitre Media, responsible for architecting and maintaining Databricks-based data pipelines that power AI-driven FinTech products. You'll design ETL workflows, ensure data quality, and mentor engineers while collaborating with leadership on data strategy.

Key Responsibilities

  • Design, implement, and optimize large-scale ETL workflows in Databricks (Apache Spark, Delta Lake, DBT)
  • Develop algorithms that transform raw market data into actionable insights
  • Own data quality and lineage with tests, monitoring, and alerting for mission-critical pipelines
  • Evolve cloud data platform (AWS & GCP) for scale, performance, and cost efficiency
  • Mentor engineers and champion best practices in code reviews, documentation, and DevOps

Required Skills & Qualifications

Must Have:

  • Expert in Python plus working knowledge of Scala or Java
  • Hands-on experience with Databricks & Spark including cluster tuning and Delta Tables
  • Strong analytical SQL, modular data-model design, and CI/CD for transformations
  • Production experience on AWS or GCP data services (S3/GCS, EMR/Dataproc, Glue/Dataflow)

Nice to Have:

  • Apache Airflow, Luigi, or Dagster for DAG orchestration
  • Experience with Looker, Tableau, or similar visualization stacks
  • Financial-markets domain knowledge (equities, ETFs, mutual funds)
  • Machine-learning engineering or statistical-analysis background

Benefits & Perks

  • Competitive compensation ($150k - $185k CAD/USD plus benefits and performance bonuses)
  • Remote flexibility within ±3 hours ET with optional hubs in Toronto and NYC
  • Budget for conferences (Data+AI Summit, NeurIPS) and continuous learning
  • Autonomy to work directly with CEO & CTO to shape data and AI strategy