Amazon S3

The Amazon S3 provider for Data Sync supports read-write operations against an Amazon S3 bucket.

Since S3 stores binary objects you need to connect this provider with a Data Sync provider that supports binary blob or file data.

The following Data Sync providers can be connected to the Amazon S3 provider.

• FileSystem Provider
• SharePoint Document Library
• SQL Server Table with Blob Column configuration.
• Azure Blob Storage

From V3.0.1290 the Amazon S3 connector supports incremental sync mode.

To connect first enter your Amazon S3 credentials then select the region and finally choose the S3 Bucket Name to connect to.

BucketName

The name of the S3 Bucket to connect to.

Prefix

Defines a Prefix to be used with S3 bucket queries, the Delimiter is always '/'.

PrefixPathRemove

Removes the Prefix from the Path when reading the S3 bucket list.

Region

The AWS region that contains your SimpleDB Domain.

AccessKeyID

The AWS AccessKey.

SecretAccessKey

The AWS Secret.

You can also use AWS IAM Users/Roles when running from an AWS VM with an IAM role assigned.

WebFriendlyPaths

Ensures that file paths are returned with forward slashes (/).

UseCustomMetaDataForDates

Defines two custom metadata fields to contain the file created and modified timestamps in UTC. Data Sync will then use these rather than the Amazon S3 LastModified field which cannot be modified.

• x-amz-meta-sourcemodifieddate
• x-amz-meta-sourcecreateddate

Data Schema

Below is the Data Schema that Data Sync returns for the Amazon S3 provider. The actual file data is not part of the schema and is read from Amazon S3 when required during the Synchronisation operation.

Example Data