Can I deploy flyte using OSS, I think it's s3 compatible

[aixi]

https://www.alibabacloud.com/help/en/oss/developer-reference/compatibility-with-amazon-s3

[davidmirror-ops]

Hi @aixi

We haven't tested it yet. It seems to support some of the base operations Flyte would perform against an S3 API endpoint:

"s3:DeleteObject*",
    "s3:GetObject*",
    "s3:PutObject*"

The exception is s3:ListBucket which in Alibaba's OSS seem to be GetBucket.

Also, I'd say that Flyte can work with virtual hosted-style requests to S3, as flytepropeller uses a similar structure.

Nevertheless, if it works, it would still classify as a custom storage backend for Flyte. To that end, users of the flyte-core chart have been successful using this configuration in the chart to consume a custom S3-compliant kv store:

  storage.yaml: | 
    storage:
      container: xxx
      stow:
        config:
          access_key_id: xxx
          auth_type: accesskey
          disable_ssl: false
          endpoint: xxx
          region: xxx
          secret_key: xxx
          v2_signing: false
        kind: s3
      type: stow
      enable-multicontainer: false
      limits:
        maxDownloadMBs: 10

Does that help?

[aixi]

Thank you for your reply, I can try on Alibaba OSS, if not work, maybe i can use a miniO.

[aixi]

I managed to deploy flyte on our local k8s cluster with Alibaba OSS. Unfortunately it's not working

The reason is Amazon S3 supports path-style URLs and virtual hosted-style URLs in requests, but Alibaba OSS supports only virtual hosted-style URLs in requests.
Is there a way to use hosted-style URLs mode to access object storage?