관련 링크

Securely transfer bulk data using IDrive® e2 Express™

IDrive® e2 Express™ lets you transfer terabytes of data to the cloud storage without straining or tying up all your network bandwidth. Your data remains protected through NAS credential-based authentication throughout the process, ensuring only authorized users can access it, even if the physical drive is lost or stolen.



목차

The following sections will help you get started with IDrive® e2 Express™ Backup:

How do I use IDrive® e2 Express™?

Follow these steps to complete your IDrive® e2 Express™ data transfer efficiently:

1단계: 주문하기 for IDrive® e2 Express™ device

  1. IDrive® e2 웹 콘솔에 로그인하세요.
  2. Navigate to the IDrive® e2 Express™ tab and fill out the form.
  3. Select the Region and enter the Size of data to be transferred.
  4. Add special requests or comments.
  5. Provide your contact details and shipping information.
  6. Review and agree to the Express Shipment Agreement and click Proceed.
  7. Review the Express Shipment Agreement and check the box to agree to the terms.
  8. Click Place an order to confirm your order.
    idrive e2
  9. A confirmation email with the order ID, job status, region, size, and contact details will be sent. The order status will appear as Initiated.
    idrive e2
  10. Review the details of your Express Backup order.
  11. Click Order Information if you wish to edit region, storage, or shipping details.
    참고:
    • Order details can be updated only till the order status is Initiated.
    • Billing address can be edited while the status is In Progress.

Note:

You can cancel an order by clicking Cancel Order while the status is Initiated or In Progress.

2단계: Track shipment and acknowledge device receipt

Once a NAS device is assigned, the order status changes to In Progress. You will receive an email with shipment details and tracking ID when the device is shipped.

After receiving the Express device,

  1. Sign in to your account and click Update status on the dashboard prompt.
  2. Click the checkbox under Update status to acknowledge the receipt of the device.
  3. Click Confirm.

Once confirmed, the order status changes to Arrived at User.

Click View Credentials to view the NAS credentials and View Script to access the bucket validation script.

3단계: Prepare your IDrive® e2 buckets

To enable features such as Object Lock, Versioning, or Encryption, you must first create buckets in IDrive® e2 before transferring data.

  1. Create buckets as required.
  2. Configure necessary settings for each bucket, including Object Lock, Versioning, or Encryption.
  3. Ensure that each bucket name:
    • Exactly matches the corresponding NAS device folder name. The names are case-sensitive.
    • Follow AWS S3 naming standards using only lowercase letters, with no spaces or special characters.

If the buckets are not pre-created,

  • They will be automatically created using the NAS folder names during the transfer.
  • Only the default bucket configuration will be applied.
  • Object Lock, Versioning, or custom Encryption features will not be enabled.

4단계: Validate the bucket names and settings

  1. Download the validate_bucketname.sh script from your IDrive® e2 dashboard.
  2. Connect to the NAS device using the provided credentials.
  3. Create folders on the NAS device. These folders map to buckets.
    Note: Ensure that the folder names follow AWS S3 naming standards using only lowercase letters, with no spaces or special characters.
  4. Run the validation script to verify that all bucket names are valid.

Important:

Bucket names must strictly comply with AWS S3 naming standards to avoid migration failures. Proceed with the data transfer only after all bucket names pass validation.

5단계: Copy data from local to IDrive® e2 Express™ device

Once you receive the Express device, connect it to your network and upload your data to it.

  1. Install Rclone.
    • For Linux, run the following command: 
      curl https://rclone.org/install.sh | sudo bash

    • For macOS, run the following command: 
      brew install rclone
    • For Windows, download it from:
      https://rclone.org/downloads/
  2. Configure the NAS (S3-compatible storage).
    • Run the following command: 
      rclone config
    • Follow the prompts to create a new remote.
      • Select S3.
      • Choose Other (S3 Compatible).
      • Enter the Access Key, Secret Key, and Endpoint.
        For example: http://your-nas-endpoint:8010.
  3. Create a bucket.
    Run the following command: 
    rclone mkdir nas:mybucket

    Note:

    • Bucket names must follow S3 naming conventions using 3–63 characters, lowercase letters only, with no underscores.
    • Global uniqueness is required only for AWS S3 and not for most private NAS deployments.
  4. Run the standard copy command as below: 
    rclone copy <source_path> nas:mybucket -P
  5. Run the performance-optimized command (recommended starting point) 
    nohup rclone copy <source_path> nas:mybucket \ 
  --transfers 16 --checkers 16 --fast-list --progress --no-traverse --stats=1s \
  --no-check-certificate --stats-log-level=INFO --log-level=INFO --log-file=transfer.log \
  --ignore-size --check-first --local-no-check-updated --local-no-set-modtime --inplace \
  --s3-chunk-size 64M --s3-upload-concurrency 4 --multi-thread-streams 4 -P > transfer.out 2>&1 &

    Note:

    • nohup keeps the transfer running even if the session disconnects.
    • Logs are saved in combined_transfer.log and combined_transfer.out.
    • The flags optimize concurrency, chunk size, and stream handling for large datasets.
    • Adjust concurrency values gradually based on CPU, memory, disk, and network capacity, as high concurrency may significantly increase resource usage.
  6. Monitor the transfer. 
    tail -f transfer.out
tail -f transfer.log
  7. Verify the transfer after completion.
    rclone check <source_path> nas:mybucket
  8. Resume interrupted transfers.

Note: If a transfer is interrupted, re-run the same command. Rclone automatically skips files that have already been transferred and resumes incomplete transfers.

6단계: Return the device after uploading data

  1. Place the NAS device and all cables securely back into the original packaging.
  2. Attach the provided return shipping label to the box.
  3. Ship the device back to IDrive® e2.

Once you have shipped the device back, sign in to your IDrive® e2 account and click Update status in the dashboard notification. Acknowledge that the device has been shipped back to us in the confirmation popup and click Confirm.

Alternatively, go to the Track Your Order section and locate the required order from the list. Under Order Information, click info icon next to the status and acknowledge that the device has been shipped back to us. The status will be updated accordingly.

Once we receive your device, the data on the Express drive will be uploaded to your buckets. You can track the progress of data upload.

You will be notified to verify the data once it is uploaded to the buckets.

Step 7: Verify data ingestion to IDrive® e2

Once the device is received by us, you will receive an email notification confirming that your IDrive® e2 Express™ drive has arrived at our data center.

The data from the Express device will then be transferred into your IDrive® e2 buckets.

Step 8: Verify and complete the data transfer

You will receive an email notification confirming the successful copying of data. A dashboard notification will also appear, prompting you to verify the accuracy of the data transfers.

Before proceeding, complete the following steps,

  1. Verify the integrity and completeness of the data uploaded to your IDrive® e2 account.
  2. Once verified, update the status to Verified by User by clicking the Update Status button in the dashboard notification, or locate your order in the Track Your Order section and click info icon next to the status under Order Information.

After your confirmation, we will proceed with secure cleanup of your NAS device. All temporary storage devices used for this service are securely erased according to the DOD 5220.22-M (E) standard before being reused.