How to specifty workgroup when using awswrangler.s3.to_parquet #2384
-
I want to write a dataframe to athena by using
But the problem is that under my AWS role I have several workgroups which have different permissions. How can I do it? |
Beta Was this translation helpful? Give feedback.
Answered by
LeonLuttenberger
Jul 6, 2023
Replies: 1 comment 1 reply
-
Hey, The When you read the data via Athena, you can specify the workgroup. But it shouldn't need any write permissions. Best regards, |
Beta Was this translation helpful? Give feedback.
1 reply
Answer selected by
evyasonov
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hey,
The
s3.to_parquet
method doesn't directly interact with Athena. It writes the data to S3, and ifdataset=True
is specified, the table information is stored in the Glue catalog. This is what makes the data accessible in Athena right away.When you read the data via Athena, you can specify the workgroup. But it shouldn't need any write permissions.
Best regards,
Leon