Contents x
Integrate CloudSoda with Backblaze B2
    • Print
    • Dark
      Light
    Contents

    Integrate CloudSoda with Backblaze B2

      • Print
      • Dark
        Light
      Article summary

      CloudSoda is a SaaS application that allows you to transfer data from an on-premise storage device (such as a network-attached storage (NAS), storage area network (SAN), or private cloud) to cloud object storage. This article provides the basics for configuring CloudSoda to transfer data between a NAS device and Backblaze B2 object storage.

      Before you begin: You must have the following environment and storage requirements:

      • A Linux host in the environment, either bare metal or virtual machine to host the SoDA Docker container. In this article, an Ubuntu 18 virtual machine is used.
      • 1 TB of storage for the root volume of the machine

      Enable Backblaze B2

      Before you begin: You must have a Backblaze B2 Cloud Storage account. If you already have a Backblaze account and the left navigation menu contains a B2 Cloud Storage section, your account is already enabled for Backblaze B2.

      1. Sign in to the Backblaze web console.
      2. In the user menu in the upper-right corner of the page, select My Settings.
      3. Under Enabled Products, select the checkbox to enable B2 Cloud Storage.
      4. Review the Terms and Conditions, and click OK to accept them. 

      Create a Bucket

      1. Sign in to the Backblaze web console.
      2. In the left navigation menu under B2 Cloud Storage, click Buckets.
      3. Click Create a Bucket.
      4. Enter a name for your bucket. Bucket names must be at least six characters and globally unique.
        A message is displayed if your bucket name is already in use.
      5. Select a privacy setting: Private or Public. Files that are in a private bucket require authentication to perform an action, for example, downloading. Public buckets do not require authentication so you can easily share files. You can change a bucket's privacy settings at any time.
      6. If applicable, enable a Backblaze B2 server-side encryption key.
      7. Enable Object Lock to restrict a file from being modified or deleted for a specified period of time.
      8. Click Create a Bucket, and copy the value that is in the Endpoint field; you may need this value later.
      9. Click Lifecycle Settings to control how long to keep the files in your new bucket.
      Note
      If this is your first time creating a public bucket, complete the following tasks to ensure that you have the correct permissions to create a public bucket:

      1. Verify your email address.
      2. Have a payment history on file, or use the credit card form to pay a small fee that is credited to your account balance.
      Note
      Copy the S3 endpoint that is displayed for use in another step.

      Create an Application Key

      Application keys control access to your Backblaze B2 Cloud Storage account and the buckets that are contained in your account.
      1. Sign in to the Backblaze web console.
      2. In the left navigation menu under B2 Cloud Storage, click Application Keys.
      3. Click Add a New Application Key, and enter an app key name. Please note: You cannot search an app key by this name; therefore, app key names are not required to be globally unique. Key names are limited to 100 characters and can contain letters, numbers, and "-", but not I18N characters, such as é, à, and ü.
      4. Select All or a specific bucket in the Allow Access to Bucket(s) dropdown menu.
      5. Optionally, select your access type (Read and Write, Read Only, or Write Only).
      6. Optionally, select the Allow List All Bucket Names checkbox (required for the B2 Native API b2_list_buckets and the S3-Compatible API S3 List Buckets operations).
      7. Optionally, enter a file name prefix to restrict application key access only to files with that prefix. Depending on what you selected in step #4, this limits application key access to files with the specified prefix for all buckets or just the selected bucket.
      8. Optionally, enter a positive integer to limit the time, in seconds, before the application key expires. The value must be less than 1000 days (in seconds).
      9. Click Create New Key, and note the resulting keyID and applicationKey values.
      Note
      When you create a new app key, the response contains the actual key string, for example N2Zug0evLcHDlh_L0Z0AJhiGGdY. You can always find the keyID on this page, but for security, the applicationKey appears only once. Make sure you copy and securely save this value elsewhere.

      Gather Local Storage Information

      1. Before you configure CloudSoda to Backblaze B2, mount your local network storage to your CloudSoda Linux machine.
      2. Use the cat command to print the /etc/fstab file, and obtain the mount entry for the network file system (NFS) mounted storage:
        freenas:/mnt/NFS1 /mnt/nfs1 nfs auto,nofail,noatime,nolock,intr,tcp,actimeo=1800 0 0
      3. Copy the following information for use in another step:
        • IP Address of NAS device
        • Export path
        • Mount options

      Add Storage Accounts

      1. Sign in to CloudSoda.
      2. In the left menu, click Add Storage. 
      3. Enter a name for your Backblaze B2 Cloud Storage target.
      4. Select Custom S3 as the storage type.
      5. Enter your Backblaze B2 bucket name.
      6. Click Add Storage.
      7. Select your new storage target.
      8. Click + next to Accessor.
      9. Enter the S3 endpoint URL, your applicationKey, and your keyID.
      10. Click Configure Accessor.

      Create a Quick Transfer

      You can run a Quick Transfer, or you can set up a Policy to run transfers on a schedule.

      1. On the dashboard, click Quick Transfer.
      2. Select a source location, and select a method to transfer data (for example, Copy).
      3. Select your Backblaze B2 bucket as your target location.
        After you chose your source and target locations, you can manipulate additional optional parameters to meet your needs (for example, Adding a Rule or Conflict Handling).
      4. Click Transfer Now, or to test your configuration before you move data, click Dry Run.
        You can monitor the job from the Jobs screen.
      5. Click the active job to view real-time statistics.

      Create a Policy

      1. On the dashboard, click New Policy.
        Selecting New Policy is similar to Quick Transfer, but it includes a scheduling component.
      2. Select a source location, and select a method to transfer data (for example, Copy).
      3. Select your Backblaze B2 bucket as your target location.
      4. Click Deploy.
        The Scheduling screen is displayed where you can deploy the policy.
      5. Set a schedule, and click Deploy.
      6. Click the new policy to view details of the policy job.
      Was this article helpful?
      Related articles
      What's Next