Back to jobsJob overview

About the role

Senior Data Engineer at ADCI - BLR 14 SEZ

Required Skills

pythonscalaawsdata lakehousevector databasesllm integrationdata pipelines

About the Role

Senior Data Engineer role at Amazon's WW FBA Central Analytics team, focusing on architecting scalable data infrastructure and integrating LLM-powered solutions. Responsibilities include building a Data Lakehouse, migrating from Redshift, and implementing vector databases for AI retrieval.

Key Responsibilities

  • Architect and implement a scalable S3-based Data Lakehouse
  • Lead migration from Redshift to a lakehouse model
  • Design centralized metrics repository and data quality frameworks
  • Architect globally distributed vector database infrastructure
  • Establish automated compliance validation frameworks

Required Skills & Qualifications

Must Have:

  • 7+ years of data engineering experience with distributed systems
  • Deep technical knowledge of AWS data services (Glue, Kinesis, Redshift, S3, Lambda)
  • Proven experience designing enterprise Data Lakehouse architectures
  • Strong programming skills in Python and/or Scala with distributed data processing frameworks

Nice to Have:

  • Experience architecting data platforms optimized for AI/ML workloads
  • Hands-on experience with vector databases at production scale
  • Deep knowledge of LLM integration patterns and retrieval optimization techniques