Questions tagged [object-storage]
The object-storage tag has no usage guidance.
377
questions
0
votes
0
answers
19
views
Manage object storage API [closed]
I have a web site of local news. The web site shows today news as a PDF file (in an iframe) and sidebar where you can navigate to the news of the past.
Every day I publish a new PDF of news and show ...
0
votes
0
answers
16
views
Multipart upload performance issues to Digital Ocean Spaces from browsers on Windows
I've run into a really strange issue with uploads to Digital Ocean Spaces.
We'd been getting more and more complaints from users (starting beginning of November) that uploads were really slow. We ...
0
votes
1
answer
26
views
multiple destination for statsd in object-server.conf of swift open stack
I want to send my statsd metrics from object server module of swift open stack to multiple hosts.
How should I change my object-server.conf in /etc/swift path?
The present version of object-server....
0
votes
0
answers
48
views
Upload object in oss on chunks with minio
I have that snippet
get_client = Minio(
endpoint='host',
access_key='',
secret_key='',
)
put_client = Minio(
endpoint='host',
access_key='',
secret_key='',
)
helpers....
0
votes
0
answers
61
views
Is there on-premise object storage solution compatible with GCS?
I know there's on-premise solution like Minio but I'm not sure it is compatible with GCS.
Is there any on-premise solution which is compatible with GCS client and its protocol? So we can store objects ...
-2
votes
1
answer
125
views
How do I install/emulate object storage locally? [closed]
There are 3 storage types I know:
File Storage (e.g. regular NTFS file system)
Block Storage (e.g. SQL server installed locally)
Object Storage
As far as I know, Object Storage is only provided by ...
-1
votes
1
answer
58
views
IBM Cloud Storage - Test Docker
Is there any way to test IBM Cloud Storage offline/on my local system?
For AWS S3 there are plenty of libraries like the following:
https://github.com/findify/s3mock
https://github.com/localstack/...
0
votes
0
answers
62
views
own domain in s3 vultr bucket
I have an S3 Vultr bucket, I'm using it to stream, but I want to use my own domain, like s3proxy.mydomain.com, instead of sjc1.vultrobjects.com/mybucket.
I want my domain (s3proxy.mydomain.com) to be ...
0
votes
0
answers
55
views
Can cloudflare R2 enable fine-grained access control?
I want to build a resource sharing site where members can download resources a certain number of times, so I need access to my backend server to determine the number of downloads available to the user....
0
votes
1
answer
85
views
About the MinIO's backup
I used the mc mirror command to perform master-slave replication, and found that it only synchronized the data of the Buckets, but not others, such as policies, groups, users, etc. If I want to ...
0
votes
0
answers
95
views
HTTP Injection Attack
Similar to SQL injection attack, we believe that our application is prone to HTTP injection attack. We have a HTTP GET API that takes a query parameter and sends the response back making a HTTP call ...
0
votes
0
answers
32
views
Unable to create instance of Cloud Object Storage
I am taking the devops course on Coursera, and one of the course assignment is to create an instance of Cloud Storage Object.
So I already had a little bit of trouble verifying, after a really long ...
1
vote
1
answer
96
views
Best practice arround using S3 as file storage for an application with database
I think that using S3-compatible to do file storage for application assets or "attachments" is one of the most common use cases, but I see a couple of issues, which I am unclear on how to ...
1
vote
1
answer
191
views
Oracle Object Storage Client NullPointerException on request
I am setting up my object storage client as described by the docs:
I'm using sdk version 3.17.0
Tested in java 17 & 19
I've used the config file with the python sdk and it was succesfull
...
0
votes
1
answer
63
views
IBM COS Python SDK | Create client/resource object authenticated via HMAC keys
Using IBM COS SDK, is it possible to create a COS client/resource without specifying the field ibm_api_key_id, instead specifying some combination of aws_access_key_id and aws_secret_access_key with ...
0
votes
1
answer
56
views
What do i set my STATIC_ROOT to when using django-storages, boto, boto3?
I am using linode object storage and django project deployed on a linode server. I have everything set up as far as the linode bucket and aws settings in my settings.py but what do I set my ...
0
votes
0
answers
14
views
Cloud Object Storage Account add Another Cloud's Bucket
Can one cloud's object storage user account able to add another s3 service provider's bucket, just like adding bucket of another account from the same cloud?
I have a app need to access raw data in ...
0
votes
0
answers
32
views
minio bucket creation failed for local alias
i have deployed minio in docker and it has following alias
I was trying to create bucket in different alias but only in play alias i was able to create bucket whereas in local getting access denied.
0
votes
0
answers
106
views
Upload file from ODI 12c linux server local directory to Oracle Object Storage folder
I have 20+ files that need to be uploaded using ODI 12c to different folders in an Oracle Object Storage bucket. The source files are in a folder in a Linux server where Oracle ODI 12c is running
I ...
0
votes
1
answer
336
views
Accessing object storage bucket with a pre-authenticated request using oci java sdk
I have only preauthenticated URL,namespace and bucket name. Is there any way to upload and download data using key with help of oci java sdk. Is there a proper documentation for this, and If there is ...
0
votes
0
answers
85
views
If possible, how to use only cURL with Aspera Shares to upload & download files
Our company is signed up to use Aspera Shares, and we're currently accessing that via their Web UI
Looking to automate the uploading and downloading of files.
A few challenges:
We're working on old ...
0
votes
1
answer
255
views
Is there a faster way to delete a MinIO bucket than `mc rb`
I have a bucket in MinIO with 1M objects of about 8KiB.
Which is stored on a single node (ec2 m5.large) with a single ec2 io2 disk .
If I delete the bucket using the following command, it takes an ...
2
votes
1
answer
583
views
Testing thanos object storage upload without waiting 2 hours
I was working on a docker-compose file using Prometheus to remote write data to a Thanos receiver. This data would then be queried by Thanos Querier as well as uploaded to minIO. When configuring the ...
0
votes
1
answer
41
views
Trouble Retrieving Metadata Information from OpenStack Swift Object using REST APIs: Need Help Adding Metadata from Horizon UI or REST API properly
I am new to OpenStack Swift and I am trying to add single/multiple metadata to an object using REST APIs. However, although I receive a 202 success response for the request, when I try to retrieve the ...
1
vote
3
answers
1k
views
Can't upload job artifacts to S3 object storage, 413 request entity too large
I am using Gitlab's CI/CD pipeline to build an image (2,080 GB), it's artifacts are saved in a S3 Object Storage. When trying to push the artifacts the Gitlab-runner throws following Error:
ERROR: ...
0
votes
0
answers
20
views
Storage Type ( File, Object ) for Distributed Real Time Software
My application is an real time analysis tool run on premise. It is checking existence of a file, if it is there, a number of parallel analysis is started in microservice architecture. Each analysis ...
2
votes
1
answer
348
views
Clouflare R2 with Firebase
I'd like to integrate the Cloudflare R2 (object storage) with my Firebase project.
Normally you would use Firebase Storage but since Google Cloud has some insanely high egress fees, I'd prefer to use ...
0
votes
1
answer
536
views
Offline object storage solution azure blob api compatible
I am looking for the offline storage solution compatible with azure blob storage API for production environment.
Example Minio for AWS S3.
Microsoft Azure Storage Emulator
is for testing purpose i can ...
-2
votes
1
answer
218
views
How is it possible to have folders in object storage? [duplicate]
As per my understanding, object storage has a 'flat' structure so you cannot create folders within buckets. However, in both GCP & AWS, I am able to upload regular folders to the buckets, which ...
1
vote
0
answers
28
views
Rails - Dragonfly image upload to OCI using angular frontend
I am uploading a file in angular and returning rails params in imageData and imageContent variable. Then in rails controller, I try to create a temp file using those parameters and assign it to the ...
2
votes
2
answers
928
views
What are the required maven dependencies to upload files to oracle object storage from Spring Boot 3.0 and Java 17?
I am trying to upload files to oracle Object Storage using Spring Boot 3.0 and Java 17. I am getting the following exception
java.util.NoSuchElementException: No http provider available; add ...
0
votes
0
answers
72
views
How to make s3fuse audit logs?
On our ubuntu server we have mounted an S3 object storage using s3fs. As Scaleway does not have native logging of their s3 object storage, we would like to do the logging on the ubuntu server instead. ...
0
votes
1
answer
809
views
Stored objects/files of Minio do not appear in local disk
I have created a folder in root direcoty, i.e. /data/test and I have already given full permissions to this folder using:
chmod 775 /data/test
Than I started MinIO, and from Minio GUI console, I ...
1
vote
0
answers
176
views
Install Zenko Cloud Server on ubuntu 20.04 for development purpose
For a couple of days, I have been trying to install the Zenko cloud server for development purposes on my ubuntu 20.04 machine. I am new to Docker and definitely not very much comfortable with ...
1
vote
1
answer
365
views
Are Azure "Block Blobs" an example of "block storage", "object storage", or (somehow) both?
My understanding is that "block storage" and "object storage" are two different, and mutually exclusive kinds of storage. Yet the name of Azure "block blobs" strongly ...
1
vote
1
answer
52
views
Are object storage objects technically object oriented class instances?
While every guide describes object storage objects as data with metaproperties, can they also be referred to as objects (i.e. class instantiation) in a OOP technical sense, of how they are implemented?...
0
votes
1
answer
157
views
Limit storage per user on minio
I am setting up minio for the first time and I wonder if there is a way to limit the storage of each user, for exemple the users gets 50GB max to create buckets and store the files.
In the docs I only ...
0
votes
0
answers
427
views
Upload Object (image file) to Linode Object Storage using PHP (Laravel) with S3Client
What could be the possible solution for this? I'm trying to upload an Object (Image file) to my Linode Object Storage, I have already set up the configuration and credentials but I'm still having ...
0
votes
1
answer
476
views
Minio Distributed Mode Error All ServerPool Must Have Same Deployment ID
I've been trying to setup Minio server in Distributed Mode using 2 nodes, but everytime I tried, I always get error "All serverPools should have same deployment ID expected xxx, got yyy".
I'...
0
votes
1
answer
331
views
How to make an upload method for a large file to Yandex Cloud Serverless function to be called on it?
So I want to have no personal server infrastructure. I want to have a HTTP API roun
t a user can upload a file into (2GB+) so that:
File would be stored to object storedge for 3 days
A serverless ...
2
votes
0
answers
1k
views
Get Full Object From Oracle Object Storage using Node.js
I am working on an nodejs image server to read and write images on Oracle Object Storage.
The issue I am having is not getting the full image when using the function getObject using the Javascript api ...
1
vote
1
answer
1k
views
Upload a MultipartFile to a Oracle ObjectStorage
I have a Rest enpoint that accept a list of MultipartFile like this:
@CrossOrigin(origins = "*", methods = {RequestMethod.POST})
@PostMapping(value = "/files", consumes = MediaType....
0
votes
1
answer
126
views
Is IBM Object Storage S3 have the compatible API with CEPH storage?
The question, pretty much, says it all, but in order to be more specific on the subject.
A production system is going to using CEPH storage which I know it has RESTful API that is compatible with the ...
3
votes
0
answers
2k
views
How to deploy MinIO object storage in K8s via Helm chart?
As a K8s and MinIO newbie/learner, I would like to enable MinIO Operator in Kubernetes cluster for object storage service via Helm Charts (https://github.com/minio/operator/tree/master/helm, v4.4.1), ...
0
votes
1
answer
63
views
How to use openstack on client side
I try to make a upload/download services of files for my website, and i'm trying to use the object storage from openstack. The thing is, i have no problem doing it via php and openstack php sdk, but ...
0
votes
0
answers
531
views
Ceph OSD crashes
I am looking for a solution that can bring up our 3 ceph OSD which are down. According to the log I can see the following output that I guess it is because of OSD are full.
At the moment 3 osd of 4 ...
1
vote
1
answer
249
views
How to hard delete objects older than n-days in LakeFS?
How to find and hard delete objects older than n-days in LakeFS? Later it'll be a scheduled job.
0
votes
1
answer
103
views
How are objects from derived classes constructed in C++
Im not a C++ pro, i've done mostly Java and C#. A teacher said something that confused me today. I've tried to validate the info by doing some research, but i ended up even more confused.
Lets say i ...
2
votes
0
answers
662
views
Error that send files into Minio Object Storage
I am trying to send files into Minio Object storage Using Apache NiFi.
Here are the scenario example:
Create files using NiFi GenerateFlowFile processor
Send the created files into Minio Object ...
0
votes
0
answers
2k
views
How to fix "NoCredentialProviders: no valid providers in chain. Deprecated" while uploading Objects in IBM Cloud
I am using the below Go lang code:
package main
import (
"bytes"
"fmt"
"net/http"
"os"
"time"
"github.com/IBM/ibm-cos-...