You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm creating a docker container using s3fs mount several buckets to load dataset for my model trainer, for some safety reasons, each container has it's one specific sts role. Just before container creatioin, i can get aws_access_key_id, aws_secret_access_key, aws_session_token from ceph sts endpoint and save into ~/.aws/credentials, buckets can be mounted as expected. But eventually token expires, i must restart all s3fs process once a hour to load new credentials, which is is not very appropriate and may lead IO exception when python script running at the right moment.
Can you please provide any mechanism to reload the new credentials without restarting s3fs process? Thank you
The text was updated successfully, but these errors were encountered:
@Scisaga
The current s3fs does not check for updates to the credential file. (In other words, it does not have a reload function)
Regarding this feature, the question of whether or not to support STS will also be an issue to consider.
It may be possible to modify it to detect file updates, but it will require a little more thought.
If the credential can be updated from outside of s3fs, you may be able to use the following DSO. https://github.com/ggtakec/s3fs-fuse-awscred-lib
Please try it and contact the issue if there is any prevention.
Additional Information
Version of s3fs being used (
s3fs --version
)V1.9.3
Version of fuse being used (
pkg-config --modversion fuse
,rpm -qi fuse
ordpkg -s fuse
)2.9.9-3
Kernel information (
uname -r
)5.4.0-155-generic
GNU/Linux Distribution, if applicable (
cat /etc/os-release
)How to run s3fs, if applicable
s3fs "$bucket:/$prefix" "$mount_point/$bucket" -o use_session_token -o url=$url -o use_path_request_style -o compat_dir -o allow_other -o dbglevel=info -o curldbg
Details about issue
I'm creating a docker container using s3fs mount several buckets to load dataset for my model trainer, for some safety reasons, each container has it's one specific sts role. Just before container creatioin, i can get aws_access_key_id, aws_secret_access_key, aws_session_token from ceph sts endpoint and save into ~/.aws/credentials, buckets can be mounted as expected. But eventually token expires, i must restart all s3fs process once a hour to load new credentials, which is is not very appropriate and may lead IO exception when python script running at the right moment.
Can you please provide any mechanism to reload the new credentials without restarting s3fs process? Thank you
The text was updated successfully, but these errors were encountered: