Back to jobsJob overview
About the role
Senior Data Engineer at ADCI - BLR 14 SEZ
Required Skills
pythonscalaawsdata lakehousevector databasesllm integrationdata pipelines
About the Role
Senior Data Engineer role at Amazon's WW FBA Central Analytics team, focusing on architecting scalable data infrastructure and integrating LLM-powered solutions. Responsibilities include building a Data Lakehouse, migrating from Redshift, and implementing vector databases for AI retrieval.Key Responsibilities
- Architect and implement a scalable S3-based Data Lakehouse
- Lead migration from Redshift to a lakehouse model
- Design centralized metrics repository and data quality frameworks
- Architect globally distributed vector database infrastructure
- Establish automated compliance validation frameworks
Required Skills & Qualifications
Must Have:
- 7+ years of data engineering experience with distributed systems
- Deep technical knowledge of AWS data services (Glue, Kinesis, Redshift, S3, Lambda)
- Proven experience designing enterprise Data Lakehouse architectures
- Strong programming skills in Python and/or Scala with distributed data processing frameworks
Nice to Have:
- Experience architecting data platforms optimized for AI/ML workloads
- Hands-on experience with vector databases at production scale
- Deep knowledge of LLM integration patterns and retrieval optimization techniques