Data Lake

Industry • E-Commerce Network for leading retailers and online shoppers Products used • Databricks Unified Analytics Platform • Snowflake Data Warehouse Customer Challenges • Needed a powerful data pipeline for processing complex JSON log structures • Intensive data processing and storage demands with 1 TB/day of new data • Minimizing specialized DevOps knowledge requirements. Solution • Decoupling storage and computing with Snowflake and Databricks • Simplified onboarding and collaboration with Databricks • Enhanced ability to run ad hoc and regularly scheduled jobs Benefits • Intelligent suggestion of additional products using behavioral analysis • Support for daily trending products using scheduled analytics jobs • Visual similarity-based recommendations based on Spark