-
Notifications
You must be signed in to change notification settings - Fork 4k
S3 - copy files between buckets from different providers. #7311
Replies: 2 comments · 5 replies
-
Hi @MarcinS-Qlos, thanks for reaching out. I noticed from your logs that you're using older version of AWS CLI. Have you considered updating it? Here's reference guide on updating CLI version: https://docs.aws.amazon.com/cli/latest/userguide/getting-started-install.html Unfortunately, we don't document support for third-party services like DigitalOcean and OVH. I would suggest reaching out to them directly via DigitalOcean and OVH. |
Beta Was this translation helpful? Give feedback.
All reactions
-
I've updated AWS CLI, almost nothing changed But problem it's not about OVH or DO. It works fine between them. The problem occurs when I try to copy or sync fromy any S3 to Amazon. I think this issue is related to how AWS CLI handles connections when Amazon S3 is used. |
Beta Was this translation helpful? Give feedback.
All reactions
-
Thanks for sharing the debug logs. Here's what I found:
There are a few possible causes for this error:
Could you try listing your buckets with Hope it helps! |
Beta Was this translation helpful? Give feedback.
All reactions
-
Bucket named like DO bucket doesn't exist on Amazon. Program is connecting only to Amazon instead of both servers. I can list both buckets separately
and amazon - it's empty so I use debug mode to make sure it works:
|
Beta Was this translation helpful? Give feedback.
All reactions
-
Hello @MarcinS-Qlos I read that you succeed to sync from DO to OVH I tried to do the same from OVH to Scaleway, but seems the Do you have a specific setting for your DO bucket? Maybe it is a public bucket? |
Beta Was this translation helpful? Give feedback.
All reactions
-
Hello @JD-ISWT after further testing I figured out that my client made a bucket at OVH with same name as the source bucket on DO. And he also used external software to sync those buckets so all our tests showed that buckets were syncing properly between DO and OVH. |
Beta Was this translation helpful? Give feedback.
All reactions
-
👍 1
-
@MarcinS-Qlos Thks for confirmation |
Beta Was this translation helpful? Give feedback.
-
Hello, I have problem with copying files from DIgitalOcean S3 bucket to AWS S3 bucket.
I'm successfully using this syntax while syncing DO S3 bucket with OVH S3 bucket:
aws s3 sync --profile digitalocean --endpoint https://fra1.digitaloceanspaces.com s3://[do bucket]/ --profile ovh --endpoint https://s3.waw.cloud.ovh.net s3://[ovh bucket]/
But when i try the same with AWS it doesn't work:
aws s3 sync --profile digitalocean --endpoint https://fra1.digitaloceanspaces.com s3://[do bucket]/ --profile amazon --endpoint https://s3.eu-central-1.amazonaws.com s3://[AWS bucket]/
I tried also without providing endpoint but result is the same, AWS Cli only tries to connect to one provider and searches for both buckets there.
Is there any, simply, way to sync buckets?
Simplest way would be stick with OVH but S3 lacks functionality to use versioning and automatically delete old files not present on source.
DO-AWS.txt
DO-OVH.txt
Beta Was this translation helpful? Give feedback.
All reactions