Questions about data distribution in minio #19436
-
I have a local cluster of two minio nodes, each with a disk drive. My question is how the data blocks and check blocks are distributed, is there a data block and check block on the disk of each node? Or is it the other way around: only data blocks on one node and check blocks on the other? |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments 12 replies
-
Data and parity blocks are distributed across servers. If you have 10 servers objects will be split across all 10, with a number of these blocks being erasure codes (parity). There are many documents on this. Maybe start with https://min.io/docs/minio/kubernetes/upstream/operations/concepts/architecture.html |
Beta Was this translation helpful? Give feedback.
-
My ultimate goal is to figure out how the data block and check block are distributed on each disk of my two nodes, and where can I see the data block and check block file |
Beta Was this translation helpful? Give feedback.
It can be either. The
xl.meta
in the parent will have that information. here is a tool that allows you to decode these files.Going into details would be too much here, since it is a too big of an issue to cover.
EcDist
is the shard distribution on disks.EcIndex
is the index of the current disk (this …