Retrieve Product Data from Shopify for Storage in Amazon S3

You can fetch product data from Shopify using the Shopify GraphQL Adapter, write the data to a stage file action, and upload that file to Amazon S3 using the Put Object operation.

This section provides an overview of the steps for implementing this pattern.

  1. Create Amazon Simple Storage Service (S3) Adapter and Shopify GraphQL Adapter connections.
  2. Create a schedule integration in the integration canvas.
  3. Drag the Shopify GraphQL Adapter into the integration canvas.
  4. Configure the Shopify GraphQL Adapter as follows:
    1. On the Basic Info page, enter an endpoint name.
    2. On the Operations page, enter the following:
      1. Select the Query operation.
      2. Select Products as the module.
      3. Select Products as the object.
      4. Select the required object fields for the query.
    3. On the Summary page, review and confirm the configuration.
  5. Configure the Shopify GraphQL request mapper by specifying the count/number of products to fetch.
  6. Drag a stage file action into the integration canvas and configure it as follows:
    1. On the Basic Info page, select Write File as the operation.
    2. Drag and drop the file reference to write.
    3. On the Configuration page, enter the following:
      1. Select CSV as the file structure.
      2. Upload a sample CSV file.
      3. Enter the file record and file record set names.
    4. On the Summary page, review and confirm the configuration.
  7. Use the mapper to map fields from the Shopify GraphQL response to the stage file structure.
  8. Drag the Amazon Simple Storage Service (S3) Adapter into the canvas and configure it as follows:
    1. On the Basic Info page, provide a name for the connection.
    2. From the Category list, select Object.
    3. From the Action, select Put Object to upload the file.
    4. On the Configuration page, specify the bucket name and object name.
    5. On the Summary Page, review and confirm the configuration.
  9. In the mapper, pass the stage file output as input to the Amazon Simple Storage Service (S3) Adapter for upload.
  10. Click Validate to ensure the integration is correctly configured.


    The integration shows the schedule, map action, invoke connection, map action, stage file action, and map action.

  11. Add a tracking element in the Business Identifier field.
  12. Activate the integration.
    The resulting file in Amazon S3 contains all product data retrieved from Shopify.