Azure Blob Storage

Amplitude's Azure Blob Storage destination exports Amplitude event data and merged user data to your Azure Blob Storage container. You can use Azure Blob Storage container policies to manage and export this data programmatically into an Azure container. Amplitude supports recurring syncs as often as hourly.

Prerequisites

Before you can export data from Amplitude to Azure Blob Storage, ensure your Azure environment meets the following prerequisites:

1. Set up Azure storage account and container:

   If you haven't already set up an Azure storage account and a Blob Storage container, follow these guides:

   • Create an Azure Storage Account
   • Create a container in Azure Blob Storage

2. Create an Azure service principal:

   Create a service principal in Azure for Amplitude to use to access your Blob Storage. Copy the tenantId, clientId, and clientSecret. Amplitude requires these details to set up the connection with Azure. Follow this guide to create a service principal:

   • Create a service principal in Azure

3. Grant required permissions to the service principal:

   Assign the necessary Azure Blob Storage permissions to your service principal:

- Microsoft.Storage/storageAccounts/blobServices/containers/blobs/write - Microsoft.Storage/storageAccounts/blobServices/containers/blobs/read - Microsoft.Storage/storageAccounts/blobServices/containers/blobs/delete

For instructions on assigning these permissions for Azure Blob Storage, refer to:

- Assign Azure Blob Storage permissions to a service principal - Tutorial: Add a role assignment condition to restrict access to blobs using the Azure portal

4. Configure network access:

   Ensure the firewalls and virtual networks settings of your Azure storage account allow access from the following Amplitude IP addresses:

   • Amplitude US IP addresses:
     • 52.33.3.219
     • 35.162.216.242
     • 52.27.10.221
   • Amplitude EU IP addresses:
     • 3.124.22.25
     • 18.157.59.125
     • 18.192.47.195

   For guidance on modifying these settings, refer to Configure Azure Storage firewalls and virtual networks.

Set up the integration

To export your Amplitude data to Azure Blob Storage:

1. In Amplitude, navigate to Data > Manage > Destinations > Add Destination.
2. Select Azure Blob Storage - Events & Merged Users.
3. On the Getting Started tab, select the data to export. Options include Export events ingested today and moving forward, Export all merged Amplitude IDs, or both. For events, you can also specify filtering conditions to export only events that meet certain criteria.

4. Review the Event table and Merge IDs table schemas and click Next.
5. In the Set Up Credentials section, enter the tenantId, clientId, and clientSecret from the service principal you created.
6. Complete the Azure Blob Storage container details in the Azure Blob Storage Container Details section. Click Next.
7. Click Next. Amplitude attempts a test upload to check that the credentials work. If the upload succeeds, click Finish to complete the Azure Blob Storage destination configuration and activation.

After setup, Amplitude sends all future events and merged users to your Azure Blob Storage on a best-effort basis. Exports typically run hourly and contain one hour of data, but may run less frequently and contain multiple hours of data.

Run a manual export

Complete a manual export to backfill and send historical data to Azure Blob Storage.

1. Open the Azure Blob Storage destination you created. Navigate to the Export Connection page.
2. Go to the Backfills tab.
3. Select the date range to export.
4. Click Start Backfill.

If the backfill date range overlaps with the date range of already exported data, Amplitude deduplicates any overlapping data.

Exported data format

Raw event file and data format

Amplitude exports data as a zipped archive of JSON files, partitioned by the hour with one or more files per hour. Each file contains one event JSON object per line.

File names have the following syntax, where the time represents when the data was uploaded to Amplitude servers in UTC (for example, server_upload_time):

projectID_yyyy-MM-dd_H#partitionInteger.json.gz

For example, the first partition of data uploaded to this project, on Jan 25, 2020, between 5 PM and 6 PM UTC, is in the file:

187520_2020-01-25_17#1.json.gz

The exported data JSON object schema is:

{
   "server_received_time": UTC ISO-8601 timestamp,
   "app": int,
   "device_carrier": string,
   "$schema":int,
   "city": string,
   "user_id": string,
   "uuid": UUID,
   "event_time": UTC ISO-8601 timestamp,
   "platform": string,
   "os_version": string,
   "amplitude_id": long,
   "processed_time": UTC ISO-8601 timestamp,
   "version_name": string,
   "ip_address": string,
   "paying": boolean,
   "dma": string,
   "group_properties": dict,
   "user_properties": dict,
   "client_upload_time": UTC ISO-8601 timestamp,
   "$insert_id": string,
   "event_type": string,
   "library":string,
   "amplitude_attribution_ids": string,
   "device_type": string,
   "device_manufacturer": string,
   "start_version": string,
   "location_lng": float,
   "server_upload_time": UTC ISO-8601 timestamp,
   "event_id": int,
   "location_lat": float,
   "os_name": string,
   "amplitude_event_type": string,
   "device_brand": string,
   "groups": dict,
   "event_properties": dict,
   "data": dict,
   "device_id": string,
   "language": string,
   "device_model": string,
   "country": string,
   "region": string,
   "is_attribution_event": bool,
   "adid": string,
   "session_id": long,
   "device_family": string,
   "sample_rate": null,
   "idfa": string,
   "client_event_time": UTC ISO-8601 timestamp,
}

Merged Amplitude IDs file and data format

Amplitude exports data as a zipped archive of JSON files. Each file contains one merged Amplitude ID JSON object per line.

File names have the following syntax, where the time represents when the data was uploaded to Amplitude servers in UTC (for example server_upload_time):

-OrgID_yyyy-MM-dd_H.json.gz

For example, data uploaded to this project, on Jan 25, 2020, between 5 PM and 6 PM UTC, is in the file:

-189524_2020-01-25_17.json.gz

The exported data JSON object schema is:

{
  "scope": int,
  "merge_time": long,
  "merge_server_time": long,
  "amplitude_id": long,
  "merged_amplitude_id": long
}