Lyve Cloud Documentation

Buckets

Q:

Does Lyve Cloud have any object naming limitations?

A:

The object name can contain any of these special characters like @, #, *, $, %, &, !, ?, , , ;, ’, ”, |, +, =, <, >, ^, (, ), {, }, [, ] and alphanumeric characters like 0-9, a-z, A-Z . However, using any of these characters can cause issues due to limiting factors of S3 client SDK .

Q:

Do buckets have a maximum storage limit?

A:

No. There is no storage limit for data stored in a single bucket in Lyve Cloud.

Q:

How do I manage my buckets using API?

A:

Lyve Cloud does not recommend managing buckets through API's. We recommend managing buckets directly from the Lyve Cloud console or from your data management platform.

Q:

How do I utilize multipart upload and identify which parts of data have successfully been uploaded?

A:

Lyve Cloud supports multipart uploads of objects up to 5TBs. Using this method, large files are broken into smaller pieces for a more efficient upload. The pieces are then put back together at the end of the process.

A multipart upload consists of three steps:

  1. Multipart upload initiation: When a multipart upload is initiated, AWS S3 will return an upload ID, which is a unique identifier for the multipart upload. This upload ID is a required field for all upload parts, list parts, complete upload or stop upload commands.

  2. Parts upload: In this step, you can specify the part numbers which you would like to upload. A part number uniquely identifies a part and its place in the uploading object. For each part upload, please save the part number and ETag value. These will be needed to complete step 3.

  3. Multipart upload completion: In this step, S3 will complete the upload by piecing the parts in order based on the part number. After a successful complete request, the individual parts will no longer exist.

For complete instructions, see Uploading and copying objects using multipart upload. If an object is above 5TB in size, then the multipart upload completion command will not succeed.  If a multi-part upload fails, the upload can resume with the part of the upload which failed. To view which parts of an upload succeeded, use the ListParts command. This will return all uploaded parts with their size and each one's part number. For more information, see: ListParts.

Q:

When should I use ListMultipartUploads API?

A:

List multipart upload lists the in-progress multipart uploads that are initiated but are not yet completed or aborted. This API allows writing code that will the uploads that are not completed successfully on time. Lyve Cloud is performing this automatically, by cancelling all pending multi parts after 24 hours.

Q:

How can a customer confirm the encryption status of their objects?

A:

Lyve Cloud enforces standard TLS 1.2 with 256-bit advanced encryption standard (AES) Galois/Counter Mode (GCM)—otherwise known as AES-256-GCM—to establish secure communications to the customer in transit and at rest. As an authenticated encryption algorithm, GCM provides proven security of the symmetric-key cryptographic cipher that has wide adoption for its performance. Seagate storage hardware is validated by Federal Information Processing Standards (FIPS) 140-2/3, which directly aligns with the Lyve Cloud focus on security and performance.

To view the objects encryption status, please follow the steps below.

Pre-requisites

  • Download a command-line tool such as AWS CLI

Open your command line application (Command Prompt for PC, Terminal for Mac) and use the following command.

--profile profile name --endpoint URL s3api head-object--bucket bucket name--key file name 
C:\Users\515515>aws --profile Kevin --endpoint https://s3.us-east-1.lyvecloud.seagate.com s3api head-object --bucket brawleytest --key Goals.docx 

Result

bytes   20900   application/vnd.openxmlformats--officedocument.wordprocessingml.document "34162b3bec92a8334bd9fca388477f85"      Mon, 06 Dec 2021 21:10:00 GMT   AES256 bytes   20900   application/vnd.openxmlformats--officedocument.wordprocessingml.document "34162b3bec92a8334bd9fca388477f85"      Mon, 06 Dec 2021 21:10:00 GMT   AES256 METADATA        20210828T175628Z        1b6a154b13045741f4b61ab07ed55567754f44aa6796cc250b2a506c6c83a11a 
METADATA        20210828T175628Z        1b6a154b13045741f4b61ab07ed55567754f44aa6796cc250b2a506c6c83a11a 

Note

The encryption is shown here as AES256 which is highlighted in bold.

Q:

Can I check bucket utilization using commands?

A:

The content and data quantity in a bucket can be viewed through the following commands.

--profile profile name –endpoint URL s3 ls –summarize –human-readable –recursive s3://bucket 
C:\Users\515515>aws –profile sv15 –endpoint https://s3.us-west-1.lyvecloud.seagate.com s3 ls –summarize –human-readable –recursive s3://mybuck 

Result

2021-07-03 22:06:34         6 Bytes my-test-file.txt 
2021-07-03 22:07:48       12 Bytes my-test-file1.txt 
2021-07-03 22:29:33       11 Bytes my-test-file2.txt 
2021-07-01 00:46:18      531 Bytes service-acounts.txt 
Total Objects: 4 Total Size: 560 Bytes 

Note

This command will list all contents in the bucket.

Q:

How can I create a bucket with object immutability (lock) enabled with a set duration using S3 API?

A:

  1. Create a bucket and enable object immutability using the following command:

    Note

    You can enable object immutability only while creating a bucket.

    aws s3api create-bucket --bucket <bucket name> --object-lock-enabled-for-bucket --profile <profile name> --endpoint <endpoint>
    aws --profile va3 --endpoint https://s3.us-east-1.lyvecloud.seagate.com s3api create-bucket --bucket mybucket --object-lock-enabled-for-bucket
    

    Response

    { 
    "Location": http://s3.us-east-1.lyvecloud.seagate.com/my-bucket-with-object-lock
    }
    
  2. Set the duration using the following command:

    aws s3api --profile <profile name>  put-object-lock-configuration --bucket <bucketname>  --object-lock-configuration <value>    --endpoint   <endpoint>
    aws --profile va3 --endpoint https://s3.us-east-1.lyvecloud.seagate.com s3api create-bucket --bucket mybucket --object-lock-enabled-for-bucket

    Response

    aws s3api --profile lcprd put-object-lock-configuration --bucket mybucket --object-lock-configuration ObjectLockEnabled="Enabled",Rule={DefaultRetention={Mode="COMPLIANCE",Days=1}} --endpoint https://s3.us-east-1.lyvecloud.seagate.com
    
    
    

Q:

How many buckets can you create in Lyve Cloud?

A:

You can create up to 100 buckets per account. If you need additional buckets, you can create a maximum of 1000 buckets. To create additional buckets, Create a support ticket.