Object Mover Overview

Object Mover allows you to store, manage and transfer files into and out of object storage on Agents running Red Hat 7, CentOS 7, or macOS 10.14.

Before you can transfer files using Object Mover, configure your Agents for local object storage, and configure your cloud storage profiles.

Overview

Object Mover jobs can send files to Amazon AWS S3, Microsoft Azure Blob storage, and Google Cloud Storage, or to other S3 compatible storage. The architecture for Object Mover jobs can vary depending on which storage is configured.

object storage flowchart

Cloud Storage

Manager+Agents supports accelerated transfers to Amazon AWS, Microsoft Azure, and Google Cloud Storage by claiming endpoints with Flight, which uses a proxy to forward files to your storage server.

Learn more about Flight

cloud object storage with fg

S3 Compatible Storage

Other S3 compatible storage is supported natively by Manager+Agents, but uses a direct, non-accelerated transfer instead a proxy to send files to storage. Your object transfer Agent must be located near your storage location to minimize latency and ensure transfers work properly.

All S3 compatible storage must be configured to support AWS V4 signatures. V2 signatures are not supported.

The following S3 compatible storage vendors have been used in Manager+Agents software testing:

  • Alibaba Cloud Storage
  • Caringo Cloud
  • EMC Elastic Cloud Storage
  • Hitachi Content Platform
  • IBM Cleversafe
  • Medianova Stook
  • NetApp StorageGRID
  • Object Matrix MatrixStore
  • SwiftStack
  • Wasabi Hot Cloud Storage
  • WD HGST ActiveScale

S3 compatible object storage

Agent Configuration

Before you can start using Object Mover, you must configure your Agents to allow them to transfer to storage objects. You can enable object storage after creating an Agent.

To configure an Agent for object storage:

  1. Select an Agent from the Agent List.
  2. Click Edit.
  3. Click to open the Object Storage tab.
  4. Enable the required options:

    • Enabling Flight Gateway allows your Agent to perform accelerated transfers to and from Amazon S3, Microsoft Azure, or Google Cloud storage.
    • Enabling S3 Compatible storage allows your Agent to transfer to and from other S3 compatible storage objects.
  5. Click OK to save your changes.

Note: When using Flight Gateway, you must enter your gateway server URL as set in your Flight Administration Console.

Enabling Flight Gateway requires you to install a Gateway Server, in order to configure an Agent's Flight Gateway Server and Port.

Note: The default port for Flight Gateway is 8443.

To complete object storage configuration, log into the Flight Gateway Admin and claim the endpoint.

Storage Profiles

Object Mover jobs use storage profiles to securely store object storage credentials for use with jobs. Once a profile is defined, it can be used for object storage transfers.

Learn more about Object Profile configuration

Job Types

Object Mover offers four job templates:

ObjectDropBox - Uploads contents of a directory to object storage

ObjectUploader - Uploads specific files or directories to object storage

ObjectDownloader - Downloads files or directories from object storage to a target directory

ObjectReplicator - Uploads files or directories from one object storage location to another

Jobs can also have Advanced Configuration options to adjust transfer scoping, network performance, and other options.

For information on bulk data migration capabilities that can transfer the largest data sets, contact Signiant Support.

File Transfer Direction

Pull Transfers

The Object Dropbox and Object Uploader job types both follow a pull transfer model.

For pull transfers, the Manager connects to the destination Agent. The destination Agent then connects to the source Agent.

objectmover dropbox uploader

Push Transfers

The Object Downloader and Object Replicator job types follow a push transfer model.

For push transfers, the Manager connects to the source Agent. The source Agent then connects to the destination Agent.

objectmover downloader

About SigniantSigniant’s intelligent file movement software helps the world’s top content creators and distributors ensure fast, secure delivery of large files over public and private networks. Built on Signiant’s patented technology, the company’s on-premises software and SaaS solutions move petabytes of high-value data every day between users, applications and systems with proven ease.LEARN MORE