Related Links

    Integrate Alluxio with IDrive® e2

    Alluxio is a high-performance distributed caching layer that brings hot data closer to compute frameworks such as Spark, Presto, and PyTorch for low-latency AI and analytics workloads. The platform bridges these engines with object storage through POSIX, S3, and Python interfaces, easing data access while reducing network overhead and cost. Integrating Alluxio with IDrive® e2 delivers a capable, scalable cloud object storage solution that integrates effortlessly for efficient hybrid and cloud-native data pipelines.

    Prerequisites:

    Before you begin, ensure the following:

    1. An active IDrive® e2 account. Sign up here if you do not have one.
    2. A bucket in IDrive® e2. Learn how to create a bucket.
    3. Valid Access Key ID and Secret Access Key. Learn how to create an access key.
    4. The latest version of Alluxio installed on your machine.

    Configure GB Labs Unify with IDrive® e2

    1. Install Alluxio, and ensure the Alluxio cluster is running.
    2. Mount IDrive® e2 as a UFS in Alluxio (you can mount it via the S3 under-storage integration in Alluxio). 
      alluxio fs mount /idrive-s3 \

      s3://your-bucket-name \  (Your iDrive e2 Bucket)
      --option alluxio.underfs.s3.endpoint=https://your-idrive-e2-endpoint.com \ (Your iDrive e2 s3 endpoint)
      --option alluxio.underfs.s3.accessKey=YOUR_ACCESS_KEY \   (Your iDrive e2 Access Key)
      --option alluxio.underfs.s3.secretKey=YOUR_SECRET_KEY \    (Your iDrive e2 Secret Key)
      --option alluxio.underfs.s3.disable.dns.buckets=true

      Note: disable.dns.buckets=true is needed for providers that do not support DNS-style bucket access.

    3. Test access to your iDrive® e2 bucket. 
      alluxio fs ls /idrive-s3

    Note: The data restoration process is managed by your backup software, which helps recover lost or compromised data. Each computing environment is unique, and factors such as data type, software settings, and system performance can impact the restoration process. If you encounter issues or have application-specific questions, please contact the technical support team for your backup software for expert assistance.