Integrate Moonwalk with Backblaze B2
    • Dark
      Light

    Integrate Moonwalk with Backblaze B2

    • Dark
      Light

    Article summary

    Moonwalk is large-scale data management software that lets you define business policies for archiving and retrieving your data. Moonwalk supports both LAN and cloud storage destinations, including Backblaze B2 Cloud Storage.

    Enable Backblaze B2

    Before you begin: You must have a Backblaze B2 Cloud Storage account. If you already have a Backblaze account and the left navigation menu contains a B2 Cloud Storage section, your account is already enabled for Backblaze B2.

    1. Sign in to the Backblaze web console.
    2. In the user menu in the upper-right corner of the page, select My Settings.
    3. Under Enabled Products, select the checkbox to enable B2 Cloud Storage.
    4. Review the Terms and Conditions, and click OK to accept them. 

    Create a Bucket

    1. Sign in to the Backblaze web console.
    2. In the left navigation menu under B2 Cloud Storage, click Buckets.
    3. Click Create a Bucket.
    4. Enter a name for your bucket. Bucket names must be at least six characters and globally unique.
      A message is displayed if your bucket name is already in use.
    5. Select a privacy setting: Private or Public. Files that are in a private bucket require authentication to perform an action, for example, downloading. Public buckets do not require authentication so you can easily share files. You can change a bucket's privacy settings at any time.
    6. If applicable, enable a Backblaze B2 server-side encryption key.
    7. Enable Object Lock to restrict a file from being modified or deleted for a specified period of time.
    8. Click Create a Bucket, and copy the value that is in the Endpoint field; you may need this value later.
    9. Click Lifecycle Settings to control how long to keep the files in your new bucket.
    Note
    If this is your first time creating a public bucket, complete the following tasks to ensure that you have the correct permissions to create a public bucket:

    1. Verify your email address.
    2. Have a payment history on file, or use the credit card form to pay a small fee that is credited to your account balance.
    Note
    Copy the S3 endpoint that is displayed for use in another step.

    Create an Application Key

    Application keys control access to your Backblaze B2 Cloud Storage account and the buckets that are contained in your account.
    1. Sign in to the Backblaze web console.
    2. In the left navigation menu under B2 Cloud Storage, click Application Keys.
    3. Click Add a New Application Key, and enter an app key name. Please note: You cannot search an app key by this name; therefore, app key names are not required to be globally unique. Key names are limited to 100 characters and can contain letters, numbers, and "-", but not I18N characters, such as é, à, and ü.
    4. Select All or a specific bucket in the Allow Access to Bucket(s) dropdown menu.
    5. Optionally, select your access type (Read and Write, Read Only, or Write Only).
    6. Optionally, select the Allow List All Bucket Names checkbox (required for the B2 Native API b2_list_buckets and the S3-Compatible API S3 List Buckets operations).
    7. Optionally, enter a file name prefix to restrict application key access only to files with that prefix. Depending on what you selected in step #4, this limits application key access to files with the specified prefix for all buckets or just the selected bucket.
    8. Optionally, enter a positive integer to limit the time, in seconds, before the application key expires. The value must be less than 1000 days (in seconds).
    9. Click Create New Key, and note the resulting keyID and applicationKey values.
    Note
    When you create a new app key, the response contains the actual key string, for example N2Zug0evLcHDlh_L0Z0AJhiGGdY. You can always find the keyID on this page, but for security, the applicationKey appears only once. Make sure you copy and securely save this value elsewhere.

    Set Up Moonwalk with Backblaze B2

    Before you begin: You must have the Moonwalk Agent running on your server. You must also install the Moonwalk S3 Config tool.

    1. On the server that runs the Moonwalk Agent, open the Moonwalk S3 Plugin installer (ex. Moonwalk S3 Plug 12_10.exe) that is located in the Windows\Plugins directory in the Moonwalk installation directory.
      You may get a message that it is already installed.
    2. Under the Windows start menu in the Moonwalk program group, select Moonwalk S3 Config.
    3. Select Generic S3 Endpoint, and click OK.
    4. On the Moonwalk Generic S3 Endpoint Config screen, enter S3 target details.
      1. Enable Supports Virtual Host Access.
      2. Enter your Backblaze B2 endpoint URL in the Server FQDN field.
      3. Enter 443 as the S3 port.
      4. Enable Use HTTPS.
    5. Enter S3 account details.
      1. Enter your Backblaze B2 key ID in the Access Key ID field.
      2. Enter your Backblaze B2 application key in the Secret Key field.
    6. Click Manage Buckets, select your Backblaze B2 bucket, and click Close.
    7. Enable Encryption, click Generate, enter a passphrase, click OK.
    8. Click Save.
      Changes are saved to s3generic.cfg.
    9. Ensure that the s3generic.cfg file was copied to the correct location on all Gateway machines: C:\Program Files\Moonwall\data\Agent\s3generic.cfg.

    Restart the Moonwalk Agent

    1. Select Administrative Tools program group.
    2. Click Services.
    3. Right-click Moonwalk Agent, and select Restart.

    Add a Source

    1. Open the Moonwalk.
    2. Click Windows Start, and select Moonwalk AdminCenter.
    3. In the Admin menu, click Sources and click + (add).
    4. Enter a name for the source.
    5. Select win as the URI type, and select a Windows directory on a server that runs the Fileserver Agent.
    6. At the win:// prompt, enter the full name of your server (including the domain name), and press Enter.
    7. Click SAVE.

    Create a Destination

    1. In the Admin menu, click Destinations and click + (add).
    2. Enter a name for the destination.
    3. Select s3generic as the URI type.
    4. Paste in the Migration URI.
    5. Click SAVE.

    Create a Rule

    1. In the Admin menu, click Rules and click + (add).
    2. Enter a name for the source.
    3. Enter details to configure your specific rule.
    4. Click SAVE.

    Rules can be stacked together. If you select more than one rule, they are combined with an “AND” operation, not “OR.”

    An Everything rule is for file system reporting or for ingest operations, whereas specific rules would be used for migrations.

    Create a Policy

    1. In the Admin menu, click Policies and click + (add).
    2. Enter a name for the policy.
    3. In the Operation menu, select Migrate.
    4. Select one or more rules.
      The rules are combined using an “And” operation. You can select simulate rule matching to visualize the resulting file selection.
    5. Click Done.

    Create a Task

    1. In the Admin menu, click Tasks and click + (add).
    2. Enter a name for the task.
    3. In the Dashboard menu, select Quick Run.
    4. For the task that you want to run, click run.

    Review File System Status

    You can view the status of the files in the Download directory by examining the attribute column. The attribute column is not visible by default.

    1. Navigate to your Download directory, and right-click Type, Size, etc.
    2. Click More, and select Attributes.
    3. Click OK.

    The following attribute symbols describe the status of the files selected for migration to the cloud. For example, a combination of L+O attributes means that the file was migrated.

    • A = Archivable
    • P = Sparse file
    • L = Reparsepoint
    • O = Offline (data has been migrated)
    • D = Directory

    For more information about using Moonwalk, see Moonwalk documentation.


    Was this article helpful?