Marketing Cloud and Amazon S3

Introduction - This leading open source community is dedicated to building sustainable ecosystems around open source projects to accelerate technology development and industry adoption. They also provide unparalleled support for open source communities through financial and intellectual resources, infrastructure, services, events, and training. Working together, their projects form the most ambitious and successful investment in the creation of shared technology. Challenge - The company adds more customers every day and consequently needed an easy way to scale their data storage. The client wants us to implement a system in which they can upload image files and excel files on Amazon S3 bucket from the Marketing cloud’s cloud pages and then get the public URL from S3 back and save that URL in the Marketing Cloud. To make this process much progressive and near-real-time, on-demand, we had to link Amazon S3 and Marketing cloud and implementation of: 1. Marketing cloud setup for data entry - To manage their marketing activities from Salesforce marketing cloud so they could connect better with their customers. For that, they want to have cloud pages, from where data can be entered in the marketing cloud. 2. Amazon S3 set up to store data files - To store the image and excel files from the marketing cloud’s cloud pages, they want to set up buckets in Amazon S3. 3. API callouts from Marketing cloud to Amazon S3 and vice-versa - To store data in Amazon S3, they want API callouts from Marketing cloud to Amazon S3, which will take the data files and save them on Amazon S3 bucket and API callouts from Amazon S3 to Marketing cloud to save the public URL in Marketing cloud. 4. Sales Cloud setup - To store the marketing cloud data in Salesforce Sales cloud, they want to have a real-time syncing between marketing cloud and sales cloud through journey builder. Solution - 1. Data Management in Marketing cloud- We created Data Extensions to store the data in Marketing cloud and cloud pages to capture the data from users. On that Cloud page, there were fields to browse for the image and excel files which we need to store at Amazon S3. 2. Data Storage in Amazon S3- We created buckets and stages in Amazon S3 to store the data files. We implemented lambda functions to store data and return the public URL in response to API callout from the Marketing cloud. 3. Connecting Marketing cloud and Amazon S3- In the Marketing cloud, we implemented API callout to Amazon S3 using server-side javascript which will send the data files and get the public URL. In Amazon S3, we implemented an API callout to the Marketing cloud which will store the data in the data extension of the marketing cloud. 4. Sales Cloud Setup- The client then wanted us to store the data in the sales cloud as well. For this, we created a journey that will run periodically and update the data from marketing-cloud data extension to the sales cloud. Results - ● By using Amazon S3 with Salesforce Marketing Cloud, we are able to increase the processing speed for data by 100 percent. ● Our solution boosted our client’s data storage’s scalability. ● The AWS services help the Salesforce DMP scale and deliver a highly flexible data-processing service to a global customer base.